-- Logs begin at Sun 2022-08-07 11:32:44 UTC, end at Sun 2022-08-07 12:44:23 UTC. -- Aug 07 12:13:09.202632 dv-cinder-849846-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 12:13:09.211172 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 12:13:09 2022] *** Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: nodename: dv-cinder-849846-8-iscsi Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: machine: x86_64 Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: clock source: unix Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: pcre jit disabled Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: detected number of CPU cores: 4 Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: current working directory: / Aug 07 12:13:09.213148 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: detected binary path: /usr/bin/uwsgi-core Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: your processes number limit is 47680 Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: your memory page size is 4096 bytes Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: detected max file descriptor number: 2048 Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: lock engine: pthread robust mutexes Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: thunder lock: enabled Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 12:13:09.214322 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 12:13:09.253295 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: Python main interpreter initialized at 0x55eee412b9c0 Aug 07 12:13:09.253295 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: python threads support enabled Aug 07 12:13:09.253295 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: your server socket listen backlog is limited to 100 connections Aug 07 12:13:09.253295 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: your mercy for graceful operations on workers is 90 seconds Aug 07 12:13:09.253657 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 12:13:09.253735 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: *** Operational MODE: preforking *** Aug 07 12:13:09.253980 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: *** uWSGI is running in multiple interpreter mode *** Aug 07 12:13:09.253980 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: spawned uWSGI master process (pid: 103716) Aug 07 12:13:09.254171 dv-cinder-849846-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 12:13:09.255574 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: spawned uWSGI worker 1 (pid: 103717, cores: 1) Aug 07 12:13:09.255574 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: spawned uWSGI worker 2 (pid: 103718, cores: 1) Aug 07 12:13:09.255574 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 12:13:09.914162 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 12:13:09.918979 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 12:13:11.000585 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:13:11.000585 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: from cryptography.utils import int_from_bytes Aug 07 12:13:11.001282 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:13:11.001282 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: from cryptography.utils import int_from_bytes Aug 07 12:13:11.004352 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:13:11.004352 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Aug 07 12:13:11.004800 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:13:11.004800 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Aug 07 12:13:13.470884 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 12:13:13.471484 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 12:13:13.471583 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 12:13:13.471934 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 12:13:13.472008 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 12:13:13.472008 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 12:13:13.472141 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 12:13:13.472253 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 12:13:13.472508 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 12:13:13.472723 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 12:13:13.472816 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473062 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473156 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473386 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473490 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473701 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.473790 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474026 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474331 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474427 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474644 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474741 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.474959 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475092 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475304 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475399 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475560 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475645 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475870 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.475969 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476180 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476266 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-8-iscsi {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476495 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476580 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-8-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476798 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.476893 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477104 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477217 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477414 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477511 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477713 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.477808 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478016 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478100 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478324 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478408 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478625 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.478817 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.480532 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.480792 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.480981 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.481281 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.481465 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.481625 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.481849 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482035 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482221 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482416 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482567 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482744 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.482923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.483152 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.483330 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.483519 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.483714 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.483873 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.484086 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.484243 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.484463 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.484650 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-8-iscsi {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.484851 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-8-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485038 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485223 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485374 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485524 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485679 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485844 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.485972 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486114 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486271 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486406 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486663 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486793 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.486955 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487111 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487249 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487375 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487504 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487636 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487759 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.487883 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488017 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488150 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488304 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488438 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488695 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.488828 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489039 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489039 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489280 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489280 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489521 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489521 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489754 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.489877 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490000 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490128 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490265 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490390 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490521 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490653 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490784 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.490950 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491124 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491250 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491378 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491501 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491625 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491765 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.491904 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492029 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492154 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492291 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492425 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492551 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492675 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492810 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.492940 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493073 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493204 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493337 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493461 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493585 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493708 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493845 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.493969 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.494099 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.494223 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.494223 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.494470 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.494607 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495343 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495477 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495601 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495724 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495847 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.495984 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496122 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496495 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496620 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.496757 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497145 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497271 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497395 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497520 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497656 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497782 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.497913 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498037 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498161 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498292 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498425 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498551 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498699 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.498835 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499089 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499227 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499364 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499487 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499611 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499739 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.499925 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500053 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500255 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500382 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500557 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500691 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500815 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.500949 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501072 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501195 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501369 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501507 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501685 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501827 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.501988 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502288 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502421 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502591 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502736 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.502885 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503050 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503212 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503338 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503517 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503652 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503816 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.503941 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504118 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504419 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504559 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504721 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.504846 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505019 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505143 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505322 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505454 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505620 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505752 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.505934 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506061 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506269 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506396 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506527 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506656 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506822 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.506950 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507142 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507275 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507433 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507577 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507749 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.507876 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508052 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508190 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508352 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508478 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508793 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.508967 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509102 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509305 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509440 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509565 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509697 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509854 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.509982 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510157 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510282 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510508 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510660 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510796 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.510973 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511186 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511314 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511438 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511578 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511714 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.511884 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512013 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512185 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512314 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512486 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512615 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512791 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.512932 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513090 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513228 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513390 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513520 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513689 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513818 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.513987 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514116 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514423 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514582 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514703 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.514897 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515061 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515225 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515353 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515526 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515660 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515823 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.515963 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.516135 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:13:13.516264 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.516467 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.516602 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.516794 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.516935 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517105 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517232 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517427 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517560 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517754 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.517892 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518072 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518205 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518385 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518512 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518694 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.518834 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519049 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519183 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519322 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519512 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519654 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519781 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.519928 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520067 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520232 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520357 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520546 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520683 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.520861 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521005 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521174 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521301 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521485 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521614 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521795 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.521932 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522103 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522229 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522406 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522540 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522718 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.522856 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523069 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523203 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523382 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523510 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523687 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.523821 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524021 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524169 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524349 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524483 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524656 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524783 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.524978 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525114 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525289 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525417 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525593 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525719 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.525899 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.526542 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.526751 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.526895 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527086 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527214 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527410 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527622 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527751 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.527886 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528011 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528135 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528312 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528454 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528621 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528749 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.528930 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529063 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529236 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529354 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529550 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529685 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529872 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.529977 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530179 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530280 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530489 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530588 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530794 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.530892 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531125 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531237 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531430 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531521 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531738 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.531826 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532042 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532143 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532344 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532433 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532642 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532745 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.532942 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533045 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533260 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533356 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533543 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533650 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533860 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.533992 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534166 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534254 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534468 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534566 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534807 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.534895 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535225 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535420 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535520 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535725 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.535829 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536029 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536117 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536332 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536423 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536638 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536726 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.536942 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537038 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537244 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537343 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537556 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537646 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537859 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.537949 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538157 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538246 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538474 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538564 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538775 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.538864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539197 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539412 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539557 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539781 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.539922 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540050 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540175 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540299 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540425 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540588 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540728 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.540906 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.541036 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.541213 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.541341 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.541521 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.542196 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.542463 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.542601 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.542792 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.542921 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543152 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543301 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543495 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543627 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543817 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.543953 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544201 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544338 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544506 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544636 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544810 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.544954 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545110 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545237 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545412 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545710 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.545838 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546012 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546139 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546308 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546435 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546608 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546736 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.546904 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547050 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547229 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547359 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547531 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547669 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547844 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.547970 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548145 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548281 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548444 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548586 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548743 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.548872 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549043 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549171 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549374 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549510 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549678 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.549889 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550026 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550161 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550311 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550626 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550760 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.550944 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551094 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551277 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551415 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551588 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551714 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.551893 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552028 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552202 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552329 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552507 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552634 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552814 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.552943 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553128 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553254 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553439 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553557 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553747 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.553874 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554052 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554199 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554366 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554500 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554669 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554803 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.554980 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555122 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555302 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555428 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555615 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555756 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.555951 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556081 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556267 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556394 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556577 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556782 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.556909 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557032 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557204 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557333 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557525 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557659 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557836 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.557963 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558149 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558286 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558463 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558600 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558766 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.558894 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559099 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559229 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559420 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559557 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559729 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.559879 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560069 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560195 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560334 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560461 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560627 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560756 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.560936 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561069 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561236 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561363 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561546 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561674 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.561884 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562017 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562174 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562301 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562484 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562620 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562788 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.562921 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563127 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563257 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563438 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563574 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563741 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.563877 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564043 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564169 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564339 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564464 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564640 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564782 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.564947 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565076 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565386 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565556 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565693 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565858 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.565985 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566155 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566289 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566466 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566603 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566768 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.566894 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567085 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567213 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567387 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567516 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567694 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.567824 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568006 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568139 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568308 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568434 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568625 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568754 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.568927 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569061 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569225 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569352 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569525 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569654 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569838 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.569964 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570144 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570265 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570442 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570546 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570737 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.570847 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571058 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571162 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571396 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571494 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571698 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571805 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.571996 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572094 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572306 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572406 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572609 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572719 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.572955 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573127 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573284 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573442 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573573 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573768 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.573917 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574045 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574171 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574322 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574462 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574631 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574761 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.574936 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575153 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575281 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575404 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575565 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575697 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.575873 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576000 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576179 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576318 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576497 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576626 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576801 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.576936 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577106 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577243 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577411 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577540 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577712 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.577841 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.578018 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.578277 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.578406 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.578612 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.578872 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579028 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579226 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579357 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579667 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579854 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.579989 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580168 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580375 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580503 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580635 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580795 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.580923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581111 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581251 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581422 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581549 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581728 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.581865 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582032 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582159 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582330 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582458 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582630 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582766 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.582932 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583077 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583290 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583418 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583549 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583687 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583840 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.583967 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584123 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584422 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584549 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584719 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.584854 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585018 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585153 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585317 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585443 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585758 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.585921 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586058 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586228 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586357 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586528 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586667 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586827 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.586964 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587153 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587293 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587456 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587592 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587751 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.587878 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.588050 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.588178 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.588389 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589036 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589271 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589442 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589575 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589724 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.589866 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590048 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590185 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590426 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590565 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590690 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590824 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.590972 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591144 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591300 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591429 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591605 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591747 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.591913 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592042 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592216 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592343 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592516 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592825 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.592963 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.593133 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.593273 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.593448 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.593589 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594222 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594356 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594472 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594579 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594695 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594830 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.594957 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595119 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595119 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595364 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595488 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595615 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595739 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.595874 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596007 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596132 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596270 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596404 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596530 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596654 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596777 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.596901 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597038 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597164 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597288 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597420 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597546 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597677 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597814 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.597940 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598104 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598235 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598404 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598533 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598703 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.598833 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599019 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599153 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599324 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599469 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599627 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599755 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.599926 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600062 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600227 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600362 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600570 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600714 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600840 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.600963 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601110 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601249 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601415 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601543 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601716 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.601845 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602015 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602153 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602319 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602628 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602762 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.602937 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603084 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603262 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603400 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603568 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603702 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603872 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.603999 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.604779 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.604913 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605085 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605221 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605393 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605531 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605692 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605821 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.605990 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606120 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606288 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606424 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606586 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606715 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.606883 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607048 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607222 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607351 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607525 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607661 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607823 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.607964 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608120 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608249 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608418 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608547 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608754 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.608892 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609052 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609180 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609388 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609515 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609689 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.609892 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610027 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610152 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610284 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610409 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610588 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610796 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.610933 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611086 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611221 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611352 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611512 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611640 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611822 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.611951 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612124 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612258 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612429 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612556 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612730 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.612866 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613028 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613156 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613343 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613477 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613648 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613775 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.613960 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614088 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614276 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614405 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614578 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614703 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.614886 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615099 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615229 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615351 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615500 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615628 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615806 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.615944 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616111 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616237 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616413 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616539 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616719 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.616860 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617026 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617155 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617334 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617462 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617641 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617776 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.617946 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618074 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618252 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618379 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618550 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618685 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618854 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.618987 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619181 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619309 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619484 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619614 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619842 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.619976 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620152 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620311 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620521 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620656 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620860 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.620996 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.621120 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.621253 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.621442 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.621569 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.621744 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.622138 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.622411 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.622554 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.622718 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.622846 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623055 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623186 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623346 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623488 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623652 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623782 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.623965 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624098 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624271 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624412 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624576 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624701 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.624874 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625010 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625283 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625425 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625588 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625714 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.625891 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626017 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626197 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626332 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626498 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626633 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626800 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.626928 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627130 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627259 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627436 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627571 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627738 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.627865 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628041 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628171 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628342 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628471 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628661 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628795 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.628958 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629085 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629274 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629403 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629656 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629791 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.629973 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630100 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630273 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630401 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630666 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630811 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.630978 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631115 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631304 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631420 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631620 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631724 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.631925 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632014 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632240 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632356 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632542 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632634 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632849 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.632948 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633153 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633242 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633470 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633561 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633783 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.633881 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634086 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634174 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634400 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634552 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634702 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634842 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.634989 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.635156 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.635375 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.635569 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.635767 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.635901 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636187 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636341 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636487 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636769 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.636913 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637048 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637331 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637475 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637612 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637754 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.637889 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638025 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638168 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638311 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638446 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638589 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638759 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.638898 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639093 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639241 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639405 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639542 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639715 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.639851 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640022 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640169 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640305 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640439 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640611 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640752 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.640915 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641071 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641266 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641403 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641537 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641663 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641801 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.641927 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642108 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642238 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642417 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642554 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642721 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.642848 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643062 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643194 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643358 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643487 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643659 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643787 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.643962 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644091 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644258 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644384 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644557 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644693 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644856 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.644992 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645189 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645322 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645488 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645623 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645802 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.645931 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646125 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646449 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646571 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646754 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.646883 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647245 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647421 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647548 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647731 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.647866 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648035 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648161 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648338 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648475 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648637 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648763 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.648932 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649060 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649226 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649354 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649525 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649658 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649829 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.649954 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650230 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650404 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650531 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650697 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.650825 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.651558 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.651726 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.651865 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652030 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652172 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652306 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652508 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652660 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652800 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.652944 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653081 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653208 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653332 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653457 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653615 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653753 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.653914 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654051 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654251 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654385 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654548 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654677 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.654867 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655021 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655192 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655318 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655508 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655636 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655814 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.655950 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656125 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656254 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656460 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656596 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656728 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.656856 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657020 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657157 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657326 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657461 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657630 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657764 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.657931 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658059 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658240 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658370 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658552 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658761 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.658865 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.659111 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.659396 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.659496 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.659720 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.659818 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660030 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660134 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660334 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660424 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660642 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660748 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.660950 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661063 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661257 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661346 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661564 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661654 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661872 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.661984 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662175 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662272 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662478 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662575 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662802 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.662900 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663140 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663247 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663460 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663548 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663780 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.663873 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664093 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664192 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664396 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664495 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.664860 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665015 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665152 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665344 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665486 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665650 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665778 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.665952 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.666081 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.666260 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.666390 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.666646 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.667338 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.667531 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.667679 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.667815 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.667942 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668112 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668242 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668422 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668553 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668728 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.668858 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669034 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669163 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669339 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669478 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669645 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669775 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.669951 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670080 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670269 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670407 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670585 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670712 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.670897 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.671067 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.671225 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.671366 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.671535 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.671747 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672004 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672131 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672344 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672485 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672655 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672784 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.672982 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673119 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673301 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673431 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673616 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673757 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.673932 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674072 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674211 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674338 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674529 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674665 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674841 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.674970 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675176 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675316 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675482 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675611 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675806 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.675943 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676106 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676236 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676407 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676528 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676713 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.676850 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677011 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677133 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677324 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677541 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677672 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.677889 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678141 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678271 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678489 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678626 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678808 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.678948 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679157 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679287 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679463 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679589 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679781 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.679910 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680084 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680211 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680391 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680520 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680696 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.680824 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681000 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681129 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681301 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681428 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681605 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681734 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.681978 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682124 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682275 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682402 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682536 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682665 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682835 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.682963 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683158 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683306 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683467 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683597 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683766 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.683905 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684089 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684228 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684391 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684521 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684700 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.684829 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685002 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685142 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685312 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685442 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685616 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685751 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.685915 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686052 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686218 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686347 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686519 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686645 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686828 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.686955 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687153 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687285 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687461 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687588 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687759 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.687886 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688062 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688188 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688359 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688486 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688664 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688800 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.688964 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689093 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689284 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689414 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689584 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689713 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.689903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690030 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690228 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690533 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690660 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690840 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.690967 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.691170 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.691272 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.691480 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.691569 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.691821 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692085 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692187 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692364 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692646 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692736 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.692975 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693072 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693294 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693466 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693602 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693698 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.693912 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694060 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694218 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694349 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694522 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694651 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694823 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.694952 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695156 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695286 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695461 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695597 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695769 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.695896 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696072 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696200 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696377 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696511 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696679 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696816 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.696984 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697111 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697286 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697420 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697590 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697728 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.697923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698215 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698344 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698662 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698843 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.698973 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699175 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699305 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699483 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699625 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699790 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.699921 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700231 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700439 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700577 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700757 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.700887 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701072 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701201 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701383 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701559 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701687 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701810 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.701979 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702129 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702320 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702485 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702626 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702753 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.702885 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703031 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703171 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703298 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703491 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703622 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703802 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.703931 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704101 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704231 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704513 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704642 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704828 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.704958 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705144 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705273 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705462 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705593 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705764 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.705906 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706081 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706216 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706392 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706522 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706697 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.706833 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707063 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707209 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707337 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707462 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707649 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707788 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.707974 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708111 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708278 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708407 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708582 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708719 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.708884 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709019 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709183 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709314 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709482 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709612 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709782 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.709910 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710084 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710213 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710383 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710523 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710681 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710818 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.710980 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711143 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711305 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711435 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711605 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711735 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.711903 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712042 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712202 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712342 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712533 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712661 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712795 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.712931 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.713057 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.713182 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.713349 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.713987 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714325 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714487 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714615 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714785 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.714922 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715106 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715250 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715418 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715557 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715716 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.715839 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716016 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716145 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716312 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716441 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716612 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716753 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.716909 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717038 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717233 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717362 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717561 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717699 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.717871 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718001 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718187 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718316 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718493 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718631 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718811 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.718937 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719135 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719250 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719444 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719565 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719758 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.719872 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.720950 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721093 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721220 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721355 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721355 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721593 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721717 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721843 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.721967 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722107 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722107 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722352 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722477 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722682 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.722885 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723065 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723206 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723345 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723471 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723595 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723728 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723862 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.723989 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724113 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724237 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724361 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724496 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724622 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724747 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724871 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.724997 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725135 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725261 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725394 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725526 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725653 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725778 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.725911 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726038 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726163 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726288 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726420 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726545 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726680 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726813 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.726938 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727085 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727222 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727357 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727483 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727608 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727735 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727861 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.727992 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728127 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728253 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728377 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728500 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728667 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728795 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.728973 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.729781 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.729950 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.730207 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.730334 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.730557 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.730699 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.730889 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731070 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731232 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731394 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731540 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731667 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731843 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.731971 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.732138 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 12:13:13.732267 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.732438 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:13:13.732684 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103718) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 12:13:13.884951 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Registered counter for database nova_api Aug 07 12:13:13.886843 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO dbcounter [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Registered counter for database nova_api Aug 07 12:13:13.906578 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:13.908158 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_db.sqlalchemy.engines [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:13.913195 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:13.914654 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writer thread running {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:13.968846 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.context [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd61ef53-90bb-452d-97fc-c001e8d92e91(cell1) {{(pid=103717) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 12:13:13.969607 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.context [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd61ef53-90bb-452d-97fc-c001e8d92e91(cell1) {{(pid=103718) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 12:13:13.972829 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:13:13.973250 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:13:13.973466 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:13:13.973936 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:13:13.974822 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:13:13.975536 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:13:13.975644 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:13:13.976002 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:13:13.976253 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:13:13.976694 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:13:13.977974 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:13:13.978782 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_concurrency.lockutils [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103718) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:13:13.980538 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Registered counter for database nova_cell0 Aug 07 12:13:13.981387 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO dbcounter [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Registered counter for database nova_cell0 Aug 07 12:13:13.985915 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Registered counter for database nova_cell1 Aug 07 12:13:13.986806 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO dbcounter [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Registered counter for database nova_cell1 Aug 07 12:13:13.993377 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:13.995909 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:13.998265 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_db.sqlalchemy.engines [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:14.000636 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_db.sqlalchemy.engines [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:14.002117 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.004369 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.005732 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writer thread running {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.011188 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writer thread running {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.147090 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Registered counter for database nova_cell0 Aug 07 12:13:14.155555 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO dbcounter [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Registered counter for database nova_cell0 Aug 07 12:13:14.156839 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:14.161285 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.164731 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG oslo_db.sqlalchemy.engines [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103718) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:13:14.169517 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writer thread running {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:13:14.603407 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:13:14.611294 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:13:14.640043 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: WARNING keystonemiddleware.auth_token [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:13:14.647214 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: WARNING keystonemiddleware.auth_token [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:13:14.951712 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:13:14.957681 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:13:14.962911 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eee412b9c0 pid: 103717 (default app) Aug 07 12:13:14.965073 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:13:14.966252 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Aug 07 12:13:14.966669 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sun Aug 7 12:13:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:13:14.987793 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: WARNING keystonemiddleware.auth_token [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:13:14.993737 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: WARNING keystonemiddleware.auth_token [None req-931d3833-d338-41ae-8f6a-b2d4ffeab678 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:13:14.999833 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eee412b9c0 pid: 103718 (default app) Aug 07 12:14:33.363527 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:33.364591 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 07 12:14:33.364979 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:33.377357 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_api:SELECT=3 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:33.378326 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_cell0:SELECT=3 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:33.379416 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_cell1:SELECT=3 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:33.380863 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:34.244240 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-6f5f315b-c054-480e-8920-9d19e736997f admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:34.276095 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-6f5f315b-c054-480e-8920-9d19e736997f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904268 Aug 07 12:14:34.277028 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 12:14:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:36.514365 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:36.515422 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f3a32542-d900-48a6-866f-49aeaf70f9c4 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 07 12:14:36.515810 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:36.984807 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-fefc1d18-9c65-4469-80a8-f89ad9ca87a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:37.004807 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:14:37.004807 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: warnings.warn(msg) Aug 07 12:14:37.091742 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-fefc1d18-9c65-4469-80a8-f89ad9ca87a9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.569588 Aug 07 12:14:37.092378 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:14:37.321348 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-643fce57-2c36-4429-92e6-1b334f7571e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:37.325647 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:14:37.325647 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:14:37.328367 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:37.329230 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:37.330149 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell1:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:37.330830 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:14:37.452584 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-643fce57-2c36-4429-92e6-1b334f7571e5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351633 Aug 07 12:14:37.453196 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 12:14:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:39.666879 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-fefc1d18-9c65-4469-80a8-f89ad9ca87a9 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:39.667931 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-fefc1d18-9c65-4469-80a8-f89ad9ca87a9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 07 12:14:39.668329 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:40.357854 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-050bc004-48c3-4291-96dd-5bd57e42da61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:40.377082 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:14:40.377082 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:14:40.501866 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-050bc004-48c3-4291-96dd-5bd57e42da61 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.826993 Aug 07 12:14:40.502636 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:14:40.515204 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-d737fb58-f5c5-494f-855a-01458b72e156 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:40.518023 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:14:40.518023 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: warnings.warn(msg) Aug 07 12:14:40.630637 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-d737fb58-f5c5-494f-855a-01458b72e156 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119282 Aug 07 12:14:40.631574 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 12:14:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:14:42.906344 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-050bc004-48c3-4291-96dd-5bd57e42da61 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:42.907398 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-050bc004-48c3-4291-96dd-5bd57e42da61 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 07 12:14:42.907985 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:43.309561 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21d20805-f350-4134-a3d2-674a51eaad8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:43.371674 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21d20805-f350-4134-a3d2-674a51eaad8b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457879 Aug 07 12:14:43.372227 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:14:43.385441 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ce673b33-84f0-499d-a5a4-91d9f9949461 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:43.455477 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ce673b33-84f0-499d-a5a4-91d9f9949461 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074316 Aug 07 12:14:43.456277 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 12:14:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:45.699441 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21d20805-f350-4134-a3d2-674a51eaad8b admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:45.701933 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21d20805-f350-4134-a3d2-674a51eaad8b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 07 12:14:45.701933 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:46.138615 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1c16da50-2c52-4ca6-b061-109ad92c85a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "swap": 0, "ram": 2048}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:46.213310 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1c16da50-2c52-4ca6-b061-109ad92c85a5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506610 Aug 07 12:14:46.214144 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:14:46.226682 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-be31aab9-e85f-4065-8e9e-56b13b1664e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:46.343197 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-be31aab9-e85f-4065-8e9e-56b13b1664e2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120878 Aug 07 12:14:46.343872 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 12:14:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:48.558966 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1c16da50-2c52-4ca6-b061-109ad92c85a5 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:48.560006 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1c16da50-2c52-4ca6-b061-109ad92c85a5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 07 12:14:48.560427 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:49.009213 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:49.087915 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521513 Aug 07 12:14:49.088760 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:14:49.100606 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b75f6120-8ce9-4fb5-b59b-dfd00f438cbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:49.222859 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-b75f6120-8ce9-4fb5-b59b-dfd00f438cbe admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125960 Aug 07 12:14:49.223624 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Sun Aug 7 12:14:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:51.466842 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:51.467923 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 07 12:14:51.468326 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:14:51.896059 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-96fe6b4d-c3a1-4fe9-9589-6028a273240e admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:51.922578 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-96fe6b4d-c3a1-4fe9-9589-6028a273240e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448183 Aug 07 12:14:51.923125 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 12:14:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:14:54.380999 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:54.382705 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-1e749282-2723-420d-897c-c839b77fd550 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 07 12:14:54.383262 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:54.806103 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6f1e6902-6cc7-4b18-b784-9cca137e658b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:54.864469 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6f1e6902-6cc7-4b18-b784-9cca137e658b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.475041 Aug 07 12:14:54.865031 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:14:54.878002 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-6977e188-01b0-487e-93d1-c00e737b19b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:54.937370 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-6977e188-01b0-487e-93d1-c00e737b19b1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063004 Aug 07 12:14:54.938044 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 12:14:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:57.120720 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-6f1e6902-6cc7-4b18-b784-9cca137e658b admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:57.121726 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-6f1e6902-6cc7-4b18-b784-9cca137e658b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 07 12:14:57.122132 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:14:57.517810 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-6c1ff3ab-0a67-430b-b9f3-df9157b7f71a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:57.589814 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-6c1ff3ab-0a67-430b-b9f3-df9157b7f71a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461433 Aug 07 12:14:57.590315 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:14:57.602891 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-365489f3-69f9-4899-b97f-823757ddd39c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:14:57.685631 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-365489f3-69f9-4899-b97f-823757ddd39c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087015 Aug 07 12:14:57.686196 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 12:14:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:14:59.868317 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-6c1ff3ab-0a67-430b-b9f3-df9157b7f71a admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:14:59.869328 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-6c1ff3ab-0a67-430b-b9f3-df9157b7f71a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 07 12:14:59.869725 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:00.227500 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-49eaec62-c5ff-44e1-9fbe-fc6d05304d45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "3", "disk": 40}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:00.298484 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-49eaec62-c5ff-44e1-9fbe-fc6d05304d45 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422419 Aug 07 12:15:00.299052 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:14:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:15:00.311041 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-704a60df-546d-4c14-b214-7459ba1cf563 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:00.388285 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-704a60df-546d-4c14-b214-7459ba1cf563 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080804 Aug 07 12:15:00.388859 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 12:15:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:15:02.823240 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-49eaec62-c5ff-44e1-9fbe-fc6d05304d45 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:02.824410 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-49eaec62-c5ff-44e1-9fbe-fc6d05304d45 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Aug 07 12:15:02.824910 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:03.265308 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-22bb0066-f507-4a5a-b847-d5ad51e6f383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "vcpus": 4, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:03.344656 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-22bb0066-f507-4a5a-b847-d5ad51e6f383 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.513653 Aug 07 12:15:03.345338 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:15:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:15:03.357953 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-2b93d947-a616-44af-a18e-55e1c5c37035 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:03.435278 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-2b93d947-a616-44af-a18e-55e1c5c37035 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080922 Aug 07 12:15:03.435906 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 12:15:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:15:05.797983 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-22bb0066-f507-4a5a-b847-d5ad51e6f383 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:05.798980 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-22bb0066-f507-4a5a-b847-d5ad51e6f383 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 07 12:15:05.799397 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:06.244926 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:06.321103 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.515349 Aug 07 12:15:06.321589 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Sun Aug 7 12:15:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:15:06.333428 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-b11e6bf2-552d-41d4-a1b9-e945bc6671bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:06.339966 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:15:06.422317 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-b11e6bf2-552d-41d4-a1b9-e945bc6671bd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092421 Aug 07 12:15:06.423319 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Sun Aug 7 12:15:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:15:26.579184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:26.580228 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 07 12:15:26.580627 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:26.972204 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-926d02f7-1c07-4b77-b6d2-be7e124ffcdd admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:26.990008 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-926d02f7-1c07-4b77-b6d2-be7e124ffcdd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403178 Aug 07 12:15:26.991160 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 12:15:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:15:28.061800 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:28.062793 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-887ff7f1-5cc8-47ad-87f2-8e0100729a67 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 07 12:15:28.063224 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:28.583289 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-8b6e97a8-c214-4e1c-aeb9-ac303e1da347 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:28.589423 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.wsgi [None req-8b6e97a8-c214-4e1c-aeb9-ac303e1da347 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-8b6e97a8-c214-4e1c-aeb9-ac303e1da347 admin admin] Request method failure captured: Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept: application/json Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept-Encoding: gzip, deflate Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Connection: keep-alive Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Content-Length: 0 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Host: 10.222.0.30 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-System-Scope: None Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: User-Agent: python-novaclient Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Auth-Token: gAAAAABi76zfFIXHlMd9Hy-BURO5biEgxcMZavxAR2sQvIGkgkVgZ2ctTzv4tE3jkwREJcYaedVR3132ifLSALSRx33RASNywgCUQx_tb9FGC0OkqBEPJ8VTTLjqJIg_1U6LELCc5sCP_cjYOvE0WWddw8fntIbr_KdldnZvtiXyMu0QKg1ggvI Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Id: None Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Name: None Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Identity-Status: Confirmed Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Is-Admin-Project: True Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Id: default Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Name: Default Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Name: admin Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Role: admin,member,reader Aug 07 12:15:28.592666 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Roles: admin,member,reader Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant: admin Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Name: admin Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User: admin Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Id: default Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Name: Default Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Name: admin Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: method: > Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: exception: Flavor 42 could not be found. Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: action_args: {'id': '42'} Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:28.594366 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:28.600623 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.602234 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-8b6e97a8-c214-4e1c-aeb9-ac303e1da347 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:28.603582 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-8b6e97a8-c214-4e1c-aeb9-ac303e1da347 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393728 Aug 07 12:15:28.603582 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 12:15:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:28.604307 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-06726cfb-00c4-48df-acc2-ce7ae0e45515 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:28.608448 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:15:28.627055 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-06726cfb-00c4-48df-acc2-ce7ae0e45515 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026260 Aug 07 12:15:28.627650 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:15:28.637553 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-d7225dce-ec62-486f-a506-f9edf46a9e90 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:28.661780 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-d7225dce-ec62-486f-a506-f9edf46a9e90 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027788 Aug 07 12:15:28.662927 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:15:28.672796 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-277efbdc-3977-4826-a6e3-420805d515c6 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:28.678625 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-277efbdc-3977-4826-a6e3-420805d515c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-277efbdc-3977-4826-a6e3-420805d515c6 admin admin] Request method failure captured: Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Host: 10.222.0.30 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi76zfFIXHlMd9Hy-BURO5biEgxcMZavxAR2sQvIGkgkVgZ2ctTzv4tE3jkwREJcYaedVR3132ifLSALSRx33RASNywgCUQx_tb9FGC0OkqBEPJ8VTTLjqJIg_1U6LELCc5sCP_cjYOvE0WWddw8fntIbr_KdldnZvtiXyMu0QKg1ggvI Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Role: admin,member,reader Aug 07 12:15:28.681923 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Roles: admin,member,reader Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User: admin Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: method: > Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: exception: Flavor 42 could not be found. Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: action_args: {'id': '42'} Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:28.686864 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:28.687903 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:28.689286 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-277efbdc-3977-4826-a6e3-420805d515c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:28.690687 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-277efbdc-3977-4826-a6e3-420805d515c6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014451 Aug 07 12:15:28.690687 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 12:15:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:29.654198 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-d7225dce-ec62-486f-a506-f9edf46a9e90 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:29.655280 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-d7225dce-ec62-486f-a506-f9edf46a9e90 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 07 12:15:29.655672 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:15:30.176313 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a656effe-4851-4e97-aebf-60222d2eca99 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:30.182124 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-a656effe-4851-4e97-aebf-60222d2eca99 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a656effe-4851-4e97-aebf-60222d2eca99 admin admin] Request method failure captured: Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Host: 10.222.0.30 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi76zhhDxonqDwd6PpJtGYrmqq5V6tKtqQ_ctnuTsrfpvJb8WVQvuTkslp7IbAIASuM6XVtAWUjIZkxuQOvy4UKDmLKi6o4nrLhDwQWFH4HpAG6O7NvlkfMD1WNne92LanTzJJK0XpY5Cgpld5R2U_2zOWBSeM9KOrr0YCg1ig1ojvZrE Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Role: admin,member,reader Aug 07 12:15:30.183648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Roles: admin,member,reader Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User: admin Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: method: > Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: exception: Flavor 84 could not be found. Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: action_args: {'id': '84'} Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:30.185226 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:30.186184 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.187562 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a656effe-4851-4e97-aebf-60222d2eca99 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:30.188822 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-a656effe-4851-4e97-aebf-60222d2eca99 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390770 Aug 07 12:15:30.188822 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 12:15:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:30.195172 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-0d097acd-6ca2-4fd4-b71d-4e81152a0498 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:30.213594 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-0d097acd-6ca2-4fd4-b71d-4e81152a0498 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022061 Aug 07 12:15:30.214056 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:15:30.223327 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b766896f-f01d-4fd8-9dbd-b9e805fcdac2 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:30.240476 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-b766896f-f01d-4fd8-9dbd-b9e805fcdac2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020622 Aug 07 12:15:30.241004 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:15:30.250494 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-b7e9defc-e98d-457b-8c36-0ba7ae1bc8a1 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:30.255778 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.wsgi [None req-b7e9defc-e98d-457b-8c36-0ba7ae1bc8a1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-b7e9defc-e98d-457b-8c36-0ba7ae1bc8a1 admin admin] Request method failure captured: Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept: application/json Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept-Encoding: gzip, deflate Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Connection: keep-alive Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Content-Length: 0 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Host: 10.222.0.30 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-System-Scope: None Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: User-Agent: python-novaclient Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Auth-Token: gAAAAABi76zhhDxonqDwd6PpJtGYrmqq5V6tKtqQ_ctnuTsrfpvJb8WVQvuTkslp7IbAIASuM6XVtAWUjIZkxuQOvy4UKDmLKi6o4nrLhDwQWFH4HpAG6O7NvlkfMD1WNne92LanTzJJK0XpY5Cgpld5R2U_2zOWBSeM9KOrr0YCg1ig1ojvZrE Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Id: None Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Name: None Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Identity-Status: Confirmed Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Is-Admin-Project: True Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Id: default Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Name: Default Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Name: admin Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Role: admin,member,reader Aug 07 12:15:30.257532 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Roles: admin,member,reader Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant: admin Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Name: admin Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User: admin Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Id: default Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Name: Default Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Name: admin Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: method: > Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: exception: Flavor 84 could not be found. Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: action_args: {'id': '84'} Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:30.259113 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:30.260102 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:30.261195 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-b7e9defc-e98d-457b-8c36-0ba7ae1bc8a1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:30.262213 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-b7e9defc-e98d-457b-8c36-0ba7ae1bc8a1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012223 Aug 07 12:15:30.262213 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sun Aug 7 12:15:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:31.236246 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b766896f-f01d-4fd8-9dbd-b9e805fcdac2 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:31.237249 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-b766896f-f01d-4fd8-9dbd-b9e805fcdac2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 07 12:15:31.237642 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:31.758068 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-aa742b07-8b82-4df5-a635-751fd849cd94 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:31.763999 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.wsgi [None req-aa742b07-8b82-4df5-a635-751fd849cd94 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-aa742b07-8b82-4df5-a635-751fd849cd94 admin admin] Request method failure captured: Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept: application/json Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Accept-Encoding: gzip, deflate Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Connection: keep-alive Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Content-Length: 0 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Host: 10.222.0.30 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Openstack-System-Scope: None Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: User-Agent: python-novaclient Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Auth-Token: gAAAAABi76zjPSYnOv4wNkq6WEKlt_pv5flz3TxLcaDSSNyLhtnOGrQafj-Pgbz5cSGCv7ooh6-9OKp_I5fe_rOPW0QY7BgK4r62v2evo-1Q8ea-mbiCQ2kXTRxqQMLrsDIP5bwO6g8k1ufL_WnaCV6Xkj-oKGrETuZRXcyr8SxiDlci4Bh9f10 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Id: None Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Domain-Name: None Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Identity-Status: Confirmed Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Is-Admin-Project: True Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Id: default Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Domain-Name: Default Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Project-Name: admin Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Role: admin,member,reader Aug 07 12:15:31.765538 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Roles: admin,member,reader Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant: admin Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-Tenant-Name: admin Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User: admin Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Id: default Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Domain-Name: Default Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: X-User-Name: admin Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: method: > Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: exception: Flavor 451 could not be found. Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: action_args: {'id': '451'} Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:31.767194 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:31.768283 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.769709 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-aa742b07-8b82-4df5-a635-751fd849cd94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103718) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:31.770984 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-aa742b07-8b82-4df5-a635-751fd849cd94 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391649 Aug 07 12:15:31.770984 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:15:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:31.777057 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a120643c-3b85-44a5-9d8e-1d9976d85a39 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:31.792496 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-a120643c-3b85-44a5-9d8e-1d9976d85a39 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018977 Aug 07 12:15:31.793024 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:15:31.802264 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:31.816964 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018196 Aug 07 12:15:31.817510 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sun Aug 7 12:15:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:15:31.826578 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1a0e46fd-06e3-44d0-bbb8-95985f84ed6f admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:31.831772 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-1a0e46fd-06e3-44d0-bbb8-95985f84ed6f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1a0e46fd-06e3-44d0-bbb8-95985f84ed6f admin admin] Request method failure captured: Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept: application/json Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Connection: keep-alive Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Content-Length: 0 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Host: 10.222.0.30 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.90 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABi76zjPSYnOv4wNkq6WEKlt_pv5flz3TxLcaDSSNyLhtnOGrQafj-Pgbz5cSGCv7ooh6-9OKp_I5fe_rOPW0QY7BgK4r62v2evo-1Q8ea-mbiCQ2kXTRxqQMLrsDIP5bwO6g8k1ufL_WnaCV6Xkj-oKGrETuZRXcyr8SxiDlci4Bh9f10 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.90 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Role: admin,member,reader Aug 07 12:15:31.833256 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Roles: admin,member,reader Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc097a340cd405e932b3797d5864d76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc097a340cd405e932b3797d5864d76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant: admin Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Id: 7cc097a340cd405e932b3797d5864d76 Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User: admin Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Id: 6e390f818f21433d9d55c5e4c3ba79e5 Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: X-User-Name: admin Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: method: > Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: exception: Flavor 451 could not be found. Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: action_args: {'id': '451'} Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:15:31.835342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:31.836449 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Aug 07 12:15:31.837812 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1a0e46fd-06e3-44d0-bbb8-95985f84ed6f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:15:31.839198 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1a0e46fd-06e3-44d0-bbb8-95985f84ed6f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012172 Aug 07 12:15:31.839198 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:15:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 07 12:15:32.790364 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:32.791400 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 07 12:15:32.791785 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:33.313946 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f5df7f26-234e-429d-984d-bb0653994254 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:33.394664 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f5df7f26-234e-429d-984d-bb0653994254 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.463834 Aug 07 12:15:33.395283 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 12:15:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:15:34.358282 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:34.359308 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 07 12:15:34.359703 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:35.005148 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-be427712-673a-4f98-9df0-d9f19a3a72fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:35.062600 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-be427712-673a-4f98-9df0-d9f19a3a72fc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.564658 Aug 07 12:15:35.063169 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 12:15:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:15:36.032330 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:36.033331 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 07 12:15:36.033723 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:36.561373 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-c05e28e5-88bf-4f09-94ab-e38bc984eb77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:36.635010 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-c05e28e5-88bf-4f09-94ab-e38bc984eb77 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.461483 Aug 07 12:15:36.635572 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 12:15:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:15:37.608912 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:37.609908 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 07 12:15:37.610298 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:38.127292 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f564a64e-b306-4901-9171-7dd9647d411d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:15:38.199848 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f564a64e-b306-4901-9171-7dd9647d411d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.451594 Aug 07 12:15:38.200397 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sun Aug 7 12:15:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:15:39.172071 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:39.173070 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 07 12:15:39.173464 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:15:39.696146 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-42071f66-a5f1-4b6f-ad93-30b371cccd3a admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:15:39.716305 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-42071f66-a5f1-4b6f-ad93-30b371cccd3a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404596 Aug 07 12:15:39.716840 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sun Aug 7 12:15:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:16:30.869133 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:30.870144 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-21ae526f-fa36-454f-995d-6526c5767103 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 07 12:16:30.870540 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Sun Aug 7 12:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:16:30.881260 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:16:31.256165 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-1ec0d588-f705-4876-a75f-8c73eaec5bf9 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:31.276905 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-1ec0d588-f705-4876-a75f-8c73eaec5bf9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400227 Aug 07 12:16:31.277448 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Sun Aug 7 12:16:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:16:31.301334 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-a55bc35e-5011-4002-8609-6790cc686985 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:31.304796 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG dbcounter [-] [103718] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103718) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:16:31.309742 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-a55bc35e-5011-4002-8609-6790cc686985 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012039 Aug 07 12:16:31.310256 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Sun Aug 7 12:16:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:16:31.322053 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-8e629a9a-9e7c-404d-b506-334e3a7fbb12 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:31.329641 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-8e629a9a-9e7c-404d-b506-334e3a7fbb12 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 Aug 07 12:16:31.330148 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Sun Aug 7 12:16:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:16:31.342092 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:31.350328 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011681 Aug 07 12:16:31.350846 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Sun Aug 7 12:16:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:16:31.362218 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-94218554-6d1f-4be9-9322-d3621e75b62d admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:16:31.369796 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-94218554-6d1f-4be9-9322-d3621e75b62d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011147 Aug 07 12:16:31.370301 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Sun Aug 7 12:16:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:19:50.040082 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:19:50.041100 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 07 12:19:50.041494 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:19:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:19:50.180311 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=6 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:19:50.338648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:19:50.341003 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:19:50.341003 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:19:50.342178 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:19:50.342658 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:19:50.343114 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:19:50.343827 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:19:50.344292 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:19:50.344715 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:19:50.378066 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-a7a74d70-60cd-4fce-ac24-a32f7359a081 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199233 Aug 07 12:19:50.378621 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:19:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:19:51.219683 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:19:51.220692 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 07 12:19:51.221086 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:19:51.414233 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:19:51.416648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:19:51.416648 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:19:51.417751 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:19:51.418223 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:19:51.418646 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:19:51.419549 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:19:51.420169 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:19:51.420585 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:19:51.439496 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-4278bcac-f48a-441c-b19c-74dfa5811743 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077508 Aug 07 12:19:51.440069 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:19:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:20:02.675249 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:20:02.676246 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 07 12:20:02.676631 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:20:02.820655 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:20:02.821288 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell1:SELECT=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:20:02.821899 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=8 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:20:02.869236 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:20:02.871676 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:20:02.871676 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:20:02.872769 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:20:02.873274 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:20:02.873705 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:20:02.874410 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:20:02.874863 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:20:02.875312 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:20:02.900946 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-17782638-5f94-4eea-85f2-c7a19ccd8a86 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085476 Aug 07 12:20:02.901505 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:20:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:20:03.727311 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: DEBUG nova.api.openstack.wsgi [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] Calling method '>' {{(pid=103718) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:20:03.727311 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: INFO nova.api.openstack.requestlog [None req-5619f9c5-47c0-4e42-8a21-d019d67a5262 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 07 12:20:03.727311 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: [pid: 103718|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Sun Aug 7 12:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:20:03.917342 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:20:03.919795 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 12:20:03.919795 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: warnings.warn(msg) Aug 07 12:20:03.920948 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:20:03.921423 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:20:03.921855 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:20:03.922572 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:20:03.923041 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:20:03.923459 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:20:03.944517 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-43fee521-7ecf-4d40-9cf5-386b2a4614f2 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079545 Aug 07 12:20:03.944998 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Sun Aug 7 12:20:03 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:20:59.773974 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: Sun Aug 7 12:20:59 2022 - graceful shutdown triggered... Aug 07 12:20:59.773517 dv-cinder-849846-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 07 12:20:59.774950 dv-cinder-849846-8-iscsi devstack@n-api.service[103717]: Gracefully killing worker 1 (pid: 103717)... Aug 07 12:20:59.775374 dv-cinder-849846-8-iscsi devstack@n-api.service[103718]: Gracefully killing worker 2 (pid: 103718)... Aug 07 12:21:00.774458 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: worker 1 buried after 1 seconds Aug 07 12:21:00.774458 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: worker 2 buried after 1 seconds Aug 07 12:21:00.774458 dv-cinder-849846-8-iscsi devstack@n-api.service[103716]: goodbye to uWSGI. Aug 07 12:21:00.775925 dv-cinder-849846-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 07 12:21:00.776469 dv-cinder-849846-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 07 12:21:00.779340 dv-cinder-849846-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 07 12:21:00.789238 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 12:21:00 2022] *** Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: nodename: dv-cinder-849846-8-iscsi Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: machine: x86_64 Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: clock source: unix Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: pcre jit disabled Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: detected number of CPU cores: 4 Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: current working directory: / Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: detected binary path: /usr/bin/uwsgi-core Aug 07 12:21:00.791306 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: your processes number limit is 47680 Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: your memory page size is 4096 bytes Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: detected max file descriptor number: 2048 Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: lock engine: pthread robust mutexes Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: thunder lock: enabled Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 07 12:21:00.792047 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 12:21:00.831798 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: Python main interpreter initialized at 0x55fc782a79c0 Aug 07 12:21:00.831798 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: python threads support enabled Aug 07 12:21:00.831798 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: your server socket listen backlog is limited to 100 connections Aug 07 12:21:00.831798 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: your mercy for graceful operations on workers is 90 seconds Aug 07 12:21:00.832277 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 12:21:00.832277 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: *** Operational MODE: preforking *** Aug 07 12:21:00.832523 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: *** uWSGI is running in multiple interpreter mode *** Aug 07 12:21:00.832523 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: spawned uWSGI master process (pid: 118225) Aug 07 12:21:00.832730 dv-cinder-849846-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 07 12:21:00.833573 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: spawned uWSGI worker 1 (pid: 118242, cores: 1) Aug 07 12:21:00.833704 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: spawned uWSGI worker 2 (pid: 118243, cores: 1) Aug 07 12:21:00.833820 dv-cinder-849846-8-iscsi devstack@n-api.service[118225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 12:21:01.494562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 12:21:01.495168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 07 12:21:02.644661 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:21:02.644661 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: from cryptography.utils import int_from_bytes Aug 07 12:21:02.645341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:21:02.645341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: from cryptography.utils import int_from_bytes Aug 07 12:21:02.662769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:21:02.662769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: from cryptography.utils import int_from_bytes Aug 07 12:21:02.663916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 12:21:02.663916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: from cryptography.utils import int_from_bytes Aug 07 12:21:04.952560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 12:21:04.953083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 12:21:04.953343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 12:21:04.953705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 12:21:04.953964 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 12:21:04.954351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.954676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.955034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.955359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.955689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.956001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.956321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.956638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.956966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.957226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.957591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.957863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-8-iscsi {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.958185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.958491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.958802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.959141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.959450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.959771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.960666 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.961225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.962684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.962684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.962684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.962684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.963015 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.963261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.963540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.963862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.964176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.964496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.964881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-8-iscsi {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.965198 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.965528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.965839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.966243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.966549 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.966858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.967217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.967540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.967857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.968185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.968505 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.968807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.969128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.969432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.969738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.970055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.970362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.970666 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.970970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.971243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.971556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.971878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.972200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.972520 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.972770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.973020 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.973338 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.973660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.973966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.974274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.974581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.974889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.975219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.975555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.975986 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.976297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.976736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.977061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.977386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.977694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.978017 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.978420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.978668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.978976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.979338 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.979660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.979969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.980275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.980595 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.980903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.981208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.981521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.981840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.982171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.982473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.982723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.983033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.983347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.983709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.983979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.984276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.984586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.984897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.985206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.985498 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.985802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.986111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.986416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.986721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.987067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.987350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.987654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.987975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.988295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.988604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.988906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.989210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.989514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.989832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.990227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.990835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.990835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.991704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.991899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.992253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.992564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.992873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.993194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.993495 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.993802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.994124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.994432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.994741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.995073 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.995385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.995690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.995989 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.996295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.996600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.996902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.997206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.997530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.997839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.998146 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.998451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.998774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:04.999134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:04.999471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:04.999891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.000130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.000461 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.000790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.001108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.001419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.001734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.002065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.002376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.002688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.003027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.003339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.003657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.003987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.004304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.004619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.004938 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.005246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.005562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.005888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.006205 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.006515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.007806 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.008519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.008997 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.009380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.009717 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.009883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 12:21:05.010452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 12:21:05.010605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.010605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.010891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 12:21:05.011095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.011246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 12:21:05.011406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.011560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 12:21:05.011799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.011963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.012110 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.012264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.012410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.012554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.012699 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.012850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.012996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.013150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.013305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.013458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.013610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.013610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.013911 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.013911 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.014202 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.014202 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.014585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.014585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.014882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.015172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.015325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.015470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-8-iscsi {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.015650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.015650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.016146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.016318 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.016493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.016732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.016955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.017105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.017268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.017414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.017570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.017722 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.017963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.018123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.018283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.018436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.018436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.018745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.018745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.019192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.019192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.019492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.019492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.019787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.019787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.020072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.020229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.020393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.020591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.020749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.020901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.021056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.021211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.021365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.021519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.021671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.021929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.022082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.022237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.022446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-8-iscsi {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.022609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.022769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.022925 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.023113 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.023275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.023421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.023721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.023721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.024117 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.024267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.024267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.024650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.024813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.024969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.025140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.025374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.025535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.025681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.025837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.026097 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.026359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.026519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.026672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.026944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.027237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.027471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.027651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.027811 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.027975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.028209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.028370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.028518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.028662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.028814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.028966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.029124 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.029381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.029543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.029689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.029834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.029979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.030133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.030287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.030440 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.030644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.030795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.030948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.031140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.031297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.031458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.031622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.031775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.031954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.032195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.032367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.032598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.032762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.032909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.033066 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.033220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.033366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.033534 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.033687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.033832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.033986 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.034131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.034276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.034419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.034574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.034827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.034988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.035173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.035344 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.035561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.035732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.035879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.036032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.036290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.036443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.036608 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.036839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.037081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.037265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.037486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.037647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.037801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.037955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.038555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.038726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.038874 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.039083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.039246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.039591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.039745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.039901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.040049 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.040196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.040341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.040487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.040487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.040828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.040988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.041144 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.041290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.041436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.041589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.041745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.041897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.042042 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.042042 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.042431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.042599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.042746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.042902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.043150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.043303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.043457 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.043617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.043762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.043907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.044059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.044213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.044367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.044521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.044678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.044932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.045092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.045248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.045402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.045582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.045801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.045959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.046112 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.046277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.046526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.046685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.046850 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.047204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.047374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.047611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.047778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.047932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.048078 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.048231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.048336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.048425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.048530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.048622 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.048711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.048795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.048887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.048979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.049074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.049246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.049346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.049433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.049543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.049799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.049895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.049989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.050096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.050204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.050291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.050377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.050462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.050553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.050647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.050739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.050984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.051087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.051903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.051903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.052295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.052841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.052841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.053009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.053213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.053314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.053518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.054368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.054490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.054668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.055015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.055134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.055353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.055624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.055733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.055960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.056243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.056341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.056581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.056842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.056948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.057292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.057486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.057603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.057810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.058098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.058202 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.058414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.058713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.058815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.059064 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.059351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.059446 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.059656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.059930 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.060027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.060273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.060521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.060616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.060912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.061115 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.061217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.061473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.061738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.061833 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.062247 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.062363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.062701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.062823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.063042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.063372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.063467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.063691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.063993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 12:21:05.064105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.064330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.064633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.064733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.064988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.065256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.065374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.065589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.065891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.066012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.066194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.066499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.066805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.067131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.067326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.067469 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.067734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.067947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.068061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.068324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.068572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.068675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.068915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.069180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.070579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.070697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.070774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.070856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.070951 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.071160 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.071445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.071658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.071975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.072151 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.072473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.072574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.072786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.073091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.073194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.073436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.073697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.073799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.074071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.074311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.074415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.074730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.074929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.075058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.075356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.075556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.075665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.075969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.076197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.076316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.076563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.076855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.076969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.077199 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.077441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.077548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.077792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.078944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.079238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.079335 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.079564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.079834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.079937 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.080170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.080462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.080711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.080810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081082 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.081967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.082270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.082362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.082591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.082869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.082976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.083208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.083504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.083610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.083808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.084114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.084216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.084416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.084712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.084814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.085075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.085388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.085512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.085672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.086017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.086127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.086594 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.086699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.086828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.087152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.087261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.087557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.087748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.087858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.088127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.088347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.088451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.088686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.088958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.089061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.089283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.089561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.089653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.089877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.090155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.090249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.090468 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.090806 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.090923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.091092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.091389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.091486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.091709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.091992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.092095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.092302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.092593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.092687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.092976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.093230 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.093342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.093589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.093834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.093934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.094191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.094424 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.094527 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.094804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.095041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.095151 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.096930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.097230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.097336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.097558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.097851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.097967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.098233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.098462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.098564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.098781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.099102 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.099223 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.099415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.100973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.101157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.101301 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.101563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.101772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.101868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.102201 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.102406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.102511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.102770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.103118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.103247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.103380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.103740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.104008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.104320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.104623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.104933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.105851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.105851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.105851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.106259 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.106574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.106887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.109321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.109321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.109321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110517 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.110895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.111976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112153 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112666 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.112985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.113344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.113496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.113843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.114034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.114133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.114633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.114850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.114951 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.115362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.115492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.115592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.115829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.116741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.116923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.117074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.117283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.117598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.117917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.118235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.118546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.118859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.119196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.119518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.119792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.119906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.120139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.120458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.120580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.120877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.120978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121199 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.121970 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.122986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.123123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.123348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.123467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.123681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.123864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124635 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.124939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.125101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.125254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.125409 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.125694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.125852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126163 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.126912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127391 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.127965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128073 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128654 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.128972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.129968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130621 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130722 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.130948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.131058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.131299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.131407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.131702 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.132694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.132798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.132873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.133100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.133615 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.133736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.133835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.133922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.134037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.134133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.134343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.134830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.134930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135263 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135468 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.135650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136776 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.136996 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137391 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.137921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.138982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.139290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.139476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.139598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.139811 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.141979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.142906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.143046 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.144942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145440 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145534 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.145843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146205 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.146986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147857 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.147953 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.148124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.148244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.148416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.148946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149608 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.149969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.150939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.151176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.151294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.151507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.151614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.151965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152275 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.152831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.153988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.154089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.154720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.154852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.154969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.155987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.156200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.156309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.156936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157369 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.157990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158615 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.158931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.159060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.159376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.159560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160706 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160706 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.160994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.161964 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.162077 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.162275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.162381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.162718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.162819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.163421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.163548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.163548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.163731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.163824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164513 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.164812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.165953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166369 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.166983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.167217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.167310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.167523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.167629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.167828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.168487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.168602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.168699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.168831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.168920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169022 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169484 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169584 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.169922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.170912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.171116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.179459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.179577 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.179676 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.179931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180039 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180539 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.180886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.181822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.182993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183189 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.183972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184597 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.184835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.185973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.186906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.187965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.188979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189249 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.189967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.190993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191360 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191756 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.191937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192517 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192775 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.192966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193845 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.193979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.194073 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.194360 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.194455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.194682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.194843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195038 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.195999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.196908 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.197832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.198946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199281 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199390 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.199991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200495 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200797 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.200890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201756 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.201844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202082 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202179 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.202881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.203979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204743 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.204929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205064 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.205863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206173 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206806 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.206988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.211976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212850 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.212955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.213974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214722 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.214947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.215055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.215299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.215633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.215813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.215966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.216283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.216423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.216595 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.216789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.216886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.217127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.217225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 12:21:05.217474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.217819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.218145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.218478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.218807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.219178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.219518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.219848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.220178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.220504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.220844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.221181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.221509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.221846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.222293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.222631 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.222956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.223335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.223675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.223994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.224310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.224633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.224953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.225269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.225689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.226080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.226666 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.227089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.227418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.227737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.228053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.228392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.228710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.229045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.229371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.229709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.230043 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.230368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.230703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.231051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.231369 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.231864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.232361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.232877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.233377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.233774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.234063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.234411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.234741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.235130 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.235461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.239997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.240613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.241777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.241777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.241932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.242340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.242898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.243290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.243596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.243919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.244256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.244585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.244914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.245241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.245566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.245895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.246224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.246548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.246869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.247243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.247694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.247896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.248667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.249017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.249346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.249673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.249998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.250323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.250648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.250978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.251328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.251651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.251973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.252318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.252655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.252995 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.253343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.253678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.254007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.254331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.254656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.255051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.255381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.255701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.256031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.256359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.256684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.257610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.258187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.258678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.259025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.259366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.259693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.261954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.262279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.262872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.263230 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.263582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.263923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.264256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.264584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.264912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.265251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.265569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.265886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.266211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.266531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.266846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.267283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.267606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.267922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.268251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.268570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.269167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.269521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.269848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.270186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.270520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.270853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.271208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.281972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.282664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.283830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.284235 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.284529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.284738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.285066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.285434 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.285767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.286424 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.286737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.287100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.287478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.287806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.288238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.288783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.289340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.289953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.290558 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.290972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.291393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.291870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.293115 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.293554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.293897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.294498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.294710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.295197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.295641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.295975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.296304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.296642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.297268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.297811 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.298154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.298677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.299082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.299402 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.310830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.311537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.312836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.313331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.313331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.313575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.313894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.314208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.314526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.314837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.315175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.315488 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.315831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.316175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.316497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.316830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.317150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.317480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.317798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.318131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.318462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.318789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.319128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.320119 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.320707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.321045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.321373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.321700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.322026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.322353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.322693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.323053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.323381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.323718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.324051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.324381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.324710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.325031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.325372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.325694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.326016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.326336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.326657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.326978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.327338 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.327660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.327982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.328371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.328638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.328976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.329313 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.329634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.329972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.330308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.330661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.330984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.331360 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.331699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.332025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.332344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.332659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 12:21:05.332909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118242) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 12:21:05.369243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO dbcounter [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Registered counter for database nova_api Aug 07 12:21:05.390866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_db.sqlalchemy.engines [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.398218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writer thread running {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.454685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.context [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd61ef53-90bb-452d-97fc-c001e8d92e91(cell1) {{(pid=118243) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 12:21:05.458684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:05.459186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:05.460784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:05.461504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:05.461946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:05.464020 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:05.465967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO dbcounter [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Registered counter for database nova_cell0 Aug 07 12:21:05.469942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO dbcounter [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Registered counter for database nova_cell1 Aug 07 12:21:05.479694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_db.sqlalchemy.engines [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.480855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_db.sqlalchemy.engines [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.485807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO dbcounter [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Registered counter for database nova_api Aug 07 12:21:05.487250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writer thread running {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.489259 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writer thread running {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.506462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.514331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writer thread running {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.572841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.context [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dd61ef53-90bb-452d-97fc-c001e8d92e91(cell1) {{(pid=118242) load_cells /opt/stack/nova/nova/context.py:464}} Aug 07 12:21:05.576917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:05.577395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:05.578985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:05.579745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:05.580194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:05.582272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:05.584283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO dbcounter [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Registered counter for database nova_cell0 Aug 07 12:21:05.588726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO dbcounter [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Registered counter for database nova_cell1 Aug 07 12:21:05.595976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.598066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.606116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writer thread running {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.607467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writer thread running {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.634960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO dbcounter [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Registered counter for database nova_cell0 Aug 07 12:21:05.641907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_db.sqlalchemy.engines [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.646249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writer thread running {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.759423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO dbcounter [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Registered counter for database nova_cell0 Aug 07 12:21:05.766194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_db.sqlalchemy.engines [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118242) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 12:21:05.770788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writer thread running {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 12:21:05.964250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: WARNING keystonemiddleware.auth_token [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:21:05.971535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: WARNING keystonemiddleware.auth_token [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:21:06.103038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: WARNING keystonemiddleware.auth_token [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:21:06.110672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: WARNING keystonemiddleware.auth_token [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:21:06.311554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: WARNING keystonemiddleware.auth_token [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:21:06.317789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: WARNING keystonemiddleware.auth_token [None req-32c2a05c-8192-4731-9bad-6327b56a9d86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:21:06.325206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc782a79c0 pid: 118243 (default app) Aug 07 12:21:06.469943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: WARNING keystonemiddleware.auth_token [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 07 12:21:06.477494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: WARNING keystonemiddleware.auth_token [None req-8e9337ab-9123-468b-8cf2-b820d9511d7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 07 12:21:06.484441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc782a79c0 pid: 118242 (default app) Aug 07 12:21:42.648331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:42.649537 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:42.653747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:42.654733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:43.939826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-94990b0b-37d7-403d-bb38-40dfb6180a38 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Action: 'create', calling method: .version_select at 0x7f77a5f92dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-153319934", "metadata": {"Type": "work"}}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:21:45.965747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:45.966873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:45.967786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:45.969515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:21:46.366916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-94990b0b-37d7-403d-bb38-40dfb6180a38 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.675719 Aug 07 12:21:46.366916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 12:21:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3678 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 12:21:46.366916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6b416848-ccec-4071-81e8-265bbdb4a686 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e85c10>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:46.585101 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6b416848-ccec-4071-81e8-265bbdb4a686 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 200 len: 352 microversion: 2.1 time: 0.259898 Aug 07 12:21:46.585861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:46 2022] GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:21:46.613868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c7c54483-b6d9-4213-bf0f-f875d49ab3b6 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a6002a60>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:47.049966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c7c54483-b6d9-4213-bf0f-f875d49ab3b6 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/5125a751-59af-43a6-8d70-1ffafc4ce2a4" status: 200 len: 350 microversion: 2.1 time: 1.087460 Aug 07 12:21:47.052171 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:45 2022] GET /compute/v2.1/os-volumes/5125a751-59af-43a6-8d70-1ffafc4ce2a4 => generated 350 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:47.600394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f5ccc7ea-fb16-46b7-b2db-782619c5b82a tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e27310>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:47.934793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f5ccc7ea-fb16-46b7-b2db-782619c5b82a tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 200 len: 353 microversion: 2.1 time: 0.334600 Aug 07 12:21:47.934793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 3/4] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:47 2022] GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 353 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:47.945854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e4e01e9f-4cce-431b-bbb2-64e1ad7f0066 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e48ee0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:48.161663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e4e01e9f-4cce-431b-bbb2-64e1ad7f0066 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 200 len: 353 microversion: 2.1 time: 0.221918 Aug 07 12:21:48.164236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 2/5] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:47 2022] GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:48.220943 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-95c93ed3-92d1-4a97-a25b-752b45115d4d tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e279d0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:48.593308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-95c93ed3-92d1-4a97-a25b-752b45115d4d tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 202 len: 0 microversion: 2.1 time: 0.414567 Aug 07 12:21:48.593871 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:21:48 2022] DELETE /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:21:48.603213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c88c91a7-aadf-4071-abe9-7203c633059a tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e0d430>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:48.699191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c88c91a7-aadf-4071-abe9-7203c633059a tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 200 len: 352 microversion: 2.1 time: 0.100725 Aug 07 12:21:48.699751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:48 2022] GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:49.714804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8517ed27-9ba6-4c88-b11e-e86087b3ba88 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Calling method '.version_select at 0x7f77a5e85dc0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:49.731183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d081a996-2d9d-4df7-8a77-563b55680961 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e48f70>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:49.793484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-8517ed27-9ba6-4c88-b11e-e86087b3ba88 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] HTTP exception thrown: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8517ed27-9ba6-4c88-b11e-e86087b3ba88 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Request method failure captured: Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 HTTP/1.1 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765W2xSlEz67CnLseYg5bivbeHk2ApwG70jQE0OiDk6lS-Cwmr2DQzIH6qgkoGyrENnzuTC-ZG2CuO3IUafrJ1X0-NH70ii35D9cpwUWYLGm9-dI51XOaU6B_fdg6oxMHzNFmZapKUnD9AXUgserZ-4S-yp2tsGH7nPMSLxDr7_pgaw Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 4463509e9402446f93dd4334865e5b36 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-VolumesGetTestJSON-547162771 Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:21:49.797663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4463509e9402446f93dd4334865e5b36", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4463509e9402446f93dd4334865e5b36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4463509e9402446f93dd4334865e5b36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4463509e9402446f93dd4334865e5b36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-VolumesGetTestJSON-547162771 Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 4463509e9402446f93dd4334865e5b36 Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-VolumesGetTestJSON-547162771 Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-VolumesGetTestJSON-547162771-project Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: f68c2c20add245868f00e405885fac16 Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-VolumesGetTestJSON-547162771-project Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '810b88e9-5e4c-416e-a27d-1db980240860'} Aug 07 12:21:49.798714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. (HTTP 404) (Request-ID: req-7186b6a2-a6a3-4fa5-9b62-3fa83f28ea06) Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:21:49.799856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:21:49.800773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 12:21:49.802881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8517ed27-9ba6-4c88-b11e-e86087b3ba88 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] Returning 404 to user: Volume 810b88e9-5e4c-416e-a27d-1db980240860 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8517ed27-9ba6-4c88-b11e-e86087b3ba88 tempest-VolumesGetTestJSON-547162771 tempest-VolumesGetTestJSON-547162771-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860" status: 404 len: 109 microversion: 2.1 time: 0.088873 Aug 07 12:21:49.805419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:49 2022] GET /compute/v2.1/os-volumes/810b88e9-5e4c-416e-a27d-1db980240860 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:21:49.936036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d081a996-2d9d-4df7-8a77-563b55680961 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6f43ee17-427f-4428-9d32-856caa0e400c" status: 200 len: 351 microversion: 2.1 time: 0.217418 Aug 07 12:21:49.937065 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 4/9] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:49 2022] GET /compute/v2.1/os-volumes/6f43ee17-427f-4428-9d32-856caa0e400c => generated 351 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:52.023240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-846c3f8e-8619-41eb-a64e-e8d1560f8da9 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a67950d0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:52.155947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-846c3f8e-8619-41eb-a64e-e8d1560f8da9 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d89a7d1c-1914-44c1-8cc7-13561ffb954f" status: 200 len: 351 microversion: 2.1 time: 0.138912 Aug 07 12:21:52.156865 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:21:52 2022] GET /compute/v2.1/os-volumes/d89a7d1c-1914-44c1-8cc7-13561ffb954f => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:52.170523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e3b6f8e4-9c1d-4dca-ad08-d287331d6d5e tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e0d5e0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:52.389696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e3b6f8e4-9c1d-4dca-ad08-d287331d6d5e tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.223094 Aug 07 12:21:52.399657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Aug 7 12:21:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:21:52.406105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bf4d94d3-7e17-4f95-8063-0bfa407b23ed tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5dfa4c0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:52.579967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bf4d94d3-7e17-4f95-8063-0bfa407b23ed tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.178372 Aug 07 12:21:52.607431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1149 bytes} [Sun Aug 7 12:21:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:52.611472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-73090eed-4c8e-442d-9541-3927031cbda7 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e0dca0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:52.912751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-73090eed-4c8e-442d-9541-3927031cbda7 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.316489 Aug 07 12:21:52.913894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1134 bytes} [Sun Aug 7 12:21:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:21:52.926903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-68cffa5c-5cae-428d-916f-d0a44ee2b4e4 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e20670>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:53.326667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-68cffa5c-5cae-428d-916f-d0a44ee2b4e4 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.403616 Aug 07 12:21:53.327558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 8/14] 10.222.0.30 () {58 vars in 1167 bytes} [Sun Aug 7 12:21:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:53.347370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c19b21ab-f3ef-406c-8269-b131c101244d tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e1f280>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:53.621978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c19b21ab-f3ef-406c-8269-b131c101244d tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.276249 Aug 07 12:21:53.621978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1170 bytes} [Sun Aug 7 12:21:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:53.649263 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-271ddcb0-8fee-4e65-bea3-6b518679313b tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e20790>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:53.866757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-271ddcb0-8fee-4e65-bea3-6b518679313b tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221495 Aug 07 12:21:53.867480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1155 bytes} [Sun Aug 7 12:21:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:21:53.886887 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7574e1e7-5699-453b-aac3-1d1729cf2515 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5e1fb80>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:54.009679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7574e1e7-5699-453b-aac3-1d1729cf2515 tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.132921 Aug 07 12:21:54.032764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 8/17] 10.222.0.30 () {58 vars in 1188 bytes} [Sun Aug 7 12:21:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:21:54.034675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e5910f5b-5d13-44c0-8840-70858447d27e tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] Calling method '.version_select at 0x7f77a5dfa550>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:54.204929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e5910f5b-5d13-44c0-8840-70858447d27e tempest-VolumesTestJSON-1096699715 tempest-VolumesTestJSON-1096699715-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.178764 Aug 07 12:21:54.219363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1155 bytes} [Sun Aug 7 12:21:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:21:55.570640 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1863599619", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "networks": [{"uuid": "41ff1267-66f7-4277-8d3f-21de209660aa"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:21:55.848879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] validate_networks() for [('41ff1267-66f7-4277-8d3f-21de209660aa', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:21:58.237559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:21:58.238159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:21:58.238383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:21:58.238798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:21:58.239237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:21:58.295814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:58.296474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:58.297060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:58.301932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:21:58.301932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:21:58.301932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:21:58.386156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Getting quotas for project 5becdfe9ba3b48d5b11668d6eeec33a4. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:21:58.424526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Getting quotas for user 5401baffbd794016b01d109e8e2529ac and project 5becdfe9ba3b48d5b11668d6eeec33a4. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:21:58.466747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:21:58.470888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:21:58.709588 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-24f88d9b-8385-4e41-a274-5e7664ef6381 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.714838 Aug 07 12:21:58.711149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 9/19] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:21:59.312870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-14100d57-f22f-4757-a0f1-2dda160bdae9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: .version_select at 0x7f77a5d971f0>, body: {"keypair": {"name": "tempest-keypair-1296144357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdZOjQXJ8fi/LnWQGOO5qD244qeNQMmB27UnO+bFvnLiRDJN94F8i0vMl6IKEf0Sg0ln2ammYd0VyRon358i6R/XhPCh89Zeholn+bRgenW0wkDhWao+zpc7rhMhggQyQ=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:21:59.415566 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-14100d57-f22f-4757-a0f1-2dda160bdae9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for project 547ebf661b1b48f289d734a71b494889. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:21:59.432273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-14100d57-f22f-4757-a0f1-2dda160bdae9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for user c8fb20cfc3b6479198059b4383f47527 and project 547ebf661b1b48f289d734a71b494889. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:21:59.641809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-14100d57-f22f-4757-a0f1-2dda160bdae9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.203472 Aug 07 12:21:59.641809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 11/20] 10.222.0.30 () {62 vars in 1200 bytes} [Sun Aug 7 12:21:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 12:21:59.655076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-03172338-10f5-4744-8d09-d4be84d20747 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:21:59.658772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-03172338-10f5-4744-8d09-d4be84d20747 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:21:59.697412 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-10430114", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:21:59.808354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] validate_networks() for [('8cb5f4a8-dc46-4932-b484-34ac93e03978', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:21:59.962533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-03172338-10f5-4744-8d09-d4be84d20747 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:21:59.990716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-03172338-10f5-4744-8d09-d4be84d20747 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1215 microversion: 2.1 time: 0.349873 Aug 07 12:21:59.994863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 12/21] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:21:59 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:00.748677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:22:00.750142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:22:00.750953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:22:00.751740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:22:00.752372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:22:00.786651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:00.787969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:00.788949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:00.790770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:00.792805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:00.793590 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:00.835734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:22:00.844753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for user 90dc7b751dd14c6f80205e709826423b and project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:22:00.862855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:22:00.866329 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:22:01.016328 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-03e98eff-8b32-4dde-8dc0-dbe9b689309c tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:01.017059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-03e98eff-8b32-4dde-8dc0-dbe9b689309c tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:01.086019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8889e448-d5e2-4e6a-b4ac-9e4c10455fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.370665 Aug 07 12:22:01.095059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 10/22] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:21:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:22:01.118951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5fdb5466-0610-4034-84f1-2d96ba624817 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:01.119607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5fdb5466-0610-4034-84f1-2d96ba624817 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:01.183647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-03e98eff-8b32-4dde-8dc0-dbe9b689309c tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:01.192458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-03e98eff-8b32-4dde-8dc0-dbe9b689309c tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1215 microversion: 2.1 time: 0.180567 Aug 07 12:22:01.193067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 13/23] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:01 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:01.281959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5fdb5466-0610-4034-84f1-2d96ba624817 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:01.313549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5fdb5466-0610-4034-84f1-2d96ba624817 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1220 microversion: 2.1 time: 0.216653 Aug 07 12:22:01.314798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:01 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:01.640271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-741499186", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:01.789854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] validate_networks() for [('8cb5f4a8-dc46-4932-b484-34ac93e03978', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:22:02.218002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ea5e6934-1fd5-41f6-864d-477e02a5483b tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:02.218847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ea5e6934-1fd5-41f6-864d-477e02a5483b tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:02.407349 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ea5e6934-1fd5-41f6-864d-477e02a5483b tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:02.422667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ea5e6934-1fd5-41f6-864d-477e02a5483b tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1215 microversion: 2.1 time: 0.208413 Aug 07 12:22:02.423312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 12/25] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:02 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:03.447482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:03.451539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:03.473860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:03.475812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:03.478312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:03.482666 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:03.485237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:03.485717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:03.805066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:03.824778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-77706fd2-fd37-43f0-8ad1-e310d8b0b006 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1219 microversion: 2.1 time: 0.384082 Aug 07 12:22:03.838152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 13/26] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:03 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1219 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:04.775245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:22:04.776342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:22:04.778784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:22:04.778784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:22:04.778784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:22:04.792107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:04.792895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:04.793644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:04.794574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:04.795234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:04.795876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:04.831108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:22:04.837589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for user 90dc7b751dd14c6f80205e709826423b and project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:22:04.853541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:22:04.854744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:04.855516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:04.857866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:22:04.866841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:04.867431 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:04.867878 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:04.868646 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:04.869105 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:04.869592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:05.058881 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:05.070658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b96e9d17-4efd-4c0e-aa3a-65dfbabe4e45 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1267 microversion: 2.1 time: 0.217634 Aug 07 12:22:05.073740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:04 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:05.092734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c744dbb0-422b-44d5-bacf-2a03a8b1b437 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.457860 Aug 07 12:22:05.094065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 14/28] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:22:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:22:05.106880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d39155ff-9b2c-43dc-ba98-55eb25a713b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:05.108027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d39155ff-9b2c-43dc-ba98-55eb25a713b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:05.223841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d39155ff-9b2c-43dc-ba98-55eb25a713b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:05.234820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d39155ff-9b2c-43dc-ba98-55eb25a713b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1221 microversion: 2.1 time: 0.132685 Aug 07 12:22:05.246894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:05 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:05.884907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-293295327", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d6ddf0f-3edc-45fa-b4b0-45d5e0c63b14"}], "security_groups": [{"name": "tempest-securitygroup--948375604"}], "key_name": "tempest-keypair-1296144357", "user_data": "}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:06.098014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:06.098672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:06.121452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:06.121950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:06.122394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:06.123141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:06.123593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:06.128046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:06.242827 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] validate_networks() for [('0d6ddf0f-3edc-45fa-b4b0-45d5e0c63b14', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:22:06.286461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:06.304637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-851b6b00-f86b-4383-8236-4098c2373076 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1285 microversion: 2.1 time: 0.210537 Aug 07 12:22:06.306036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 16/30] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:06 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:06.720516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ad352191-c0d8-4d7a-a042-f51bcbd55a99 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Action: 'create', calling method: .version_select at 0x7f77a551f8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-588827210", "metadata": {"Type": "work"}}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ad352191-c0d8-4d7a-a042-f51bcbd55a99 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 121 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:06.733444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-588827210", "metadata": {"Type": "work"}}} Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:06.734597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-588827210', 'metadata': {'Type': 'work'}}}} Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise error Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi '#$%' Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:06.735310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 12:22:06.736404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 12:22:06.737365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 07 12:22:06.737365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.737365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ad352191-c0d8-4d7a-a042-f51bcbd55a99 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:06.737365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ad352191-c0d8-4d7a-a042-f51bcbd55a99 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.429142 Aug 07 12:22:06.743733 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 17/31] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 12:22:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 434 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:22:06.752315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:06.758232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:06.774771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:06.776929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:06.777756 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:06.780487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:06.781616 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:06.783277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:06.948355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:06.962855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9c90f9b8-855a-4be7-bcbf-b12d76ff186c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1225 microversion: 2.1 time: 0.220588 Aug 07 12:22:06.980686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 18/32] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:06 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1225 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:06.987792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-177956c9-e976-4e52-9d1f-ff5ab90df121 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Action: 'create', calling method: .version_select at 0x7f77a4c12f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1189376577", "metadata": {"Type": "work"}}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-177956c9-e976-4e52-9d1f-ff5ab90df121 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 120 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:06.993750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1189376577", "metadata": {"Type": "work"}}} Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:06.994871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1189376577', 'metadata': {'Type': 'work'}}}} Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise error Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi '0' Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:06.996121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 12:22:06.997221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 12:22:06.998763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 07 12:22:06.998763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:06.999783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-177956c9-e976-4e52-9d1f-ff5ab90df121 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:07.001428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-177956c9-e976-4e52-9d1f-ff5ab90df121 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018625 Aug 07 12:22:07.002922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 19/33] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 12:22:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:22:07.029143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aee748bb-98d7-4f95-82d6-253ac90df92e tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Action: 'create', calling method: .version_select at 0x7f77a4c309d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-108523547", "metadata": {"Type": "work"}}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aee748bb-98d7-4f95-82d6-253ac90df92e tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 118 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:07.036508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-108523547", "metadata": {"Type": "work"}}} Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:07.038800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-108523547', 'metadata': {'Type': 'work'}}}} Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise error Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi '' Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:07.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 07 12:22:07.043591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 07 12:22:07.044772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 07 12:22:07.044772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.046451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aee748bb-98d7-4f95-82d6-253ac90df92e tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:07.047379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aee748bb-98d7-4f95-82d6-253ac90df92e tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028737 Aug 07 12:22:07.051450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 20/34] 10.222.0.30 () {60 vars in 1156 bytes} [Sun Aug 7 12:22:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 07 12:22:07.063370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8010e0e2-3d52-4b46-949c-83b988a3d0f6 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Calling method '.version_select at 0x7f77a4c3aaf0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:07.129716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-8010e0e2-3d52-4b46-949c-83b988a3d0f6 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] HTTP exception thrown: Volume tempest-invalid-416593702 could not be found. Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8010e0e2-3d52-4b46-949c-83b988a3d0f6 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-416593702 HTTP/1.1 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:07.135071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Volume tempest-invalid-416593702 could not be found. Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'tempest-invalid-416593702'} Aug 07 12:22:07.136315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-416593702 could not be found. (HTTP 404) (Request-ID: req-5e6d6920-cd7c-4d31-86e2-148d23ab727f) Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.137098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:22:07.138083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-416593702 could not be found. Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:22:07.139041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-416593702 could not be found. Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-416593702 could not be found. Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8010e0e2-3d52-4b46-949c-83b988a3d0f6 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 404 to user: Volume tempest-invalid-416593702 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8010e0e2-3d52-4b46-949c-83b988a3d0f6 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-416593702" status: 404 len: 98 microversion: 2.1 time: 0.077531 Aug 07 12:22:07.142820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 21/35] 10.222.0.30 () {58 vars in 1215 bytes} [Sun Aug 7 12:22:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-416593702 => generated 98 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 07 12:22:07.148793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-541480af-71e5-4c9a-9e8c-6c777aa30ac7 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004294 Aug 07 12:22:07.149211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 22/36] 10.222.0.30 () {58 vars in 1140 bytes} [Sun Aug 7 12:22:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 07 12:22:07.160399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4bf7dfb2-9b91-4b5e-8ee6-75712b038d4a tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004211 Aug 07 12:22:07.166082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 23/37] 10.222.0.30 () {58 vars in 1137 bytes} [Sun Aug 7 12:22:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 07 12:22:07.176684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-58523620-0ebf-4e52-81d0-87a93cd31313 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Calling method '.version_select at 0x7f77a551f8b0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:07.240872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-58523620-0ebf-4e52-81d0-87a93cd31313 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] HTTP exception thrown: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-58523620-0ebf-4e52-81d0-87a93cd31313 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/os-volumes/3f98ed4c-47ec-44ee-b12c-b9da865de778 HTTP/1.1 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:07.242894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '3f98ed4c-47ec-44ee-b12c-b9da865de778'} Aug 07 12:22:07.244158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. (HTTP 404) (Request-ID: req-e229a791-940a-48f9-87c6-db363c87ab5e) Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.245927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:22:07.247449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 12:22:07.250565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-58523620-0ebf-4e52-81d0-87a93cd31313 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 404 to user: Volume 3f98ed4c-47ec-44ee-b12c-b9da865de778 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-58523620-0ebf-4e52-81d0-87a93cd31313 tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/3f98ed4c-47ec-44ee-b12c-b9da865de778" status: 404 len: 109 microversion: 2.1 time: 0.071751 Aug 07 12:22:07.254192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 24/38] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:22:07 2022] DELETE /compute/v2.1/os-volumes/3f98ed4c-47ec-44ee-b12c-b9da865de778 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:22:07.268655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb3d5a80-ca6a-4aad-948d-9983bbcf282b tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Calling method '.version_select at 0x7f77a4c30af0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:07.322177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-fb3d5a80-ca6a-4aad-948d-9983bbcf282b tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] HTTP exception thrown: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb3d5a80-ca6a-4aad-948d-9983bbcf282b tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Request method failure captured: Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/os-volumes/ff14914b-d9b1-4e6b-b556-db09f4552ac0 HTTP/1.1 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765t7eZ4TpM3VVa0WQw82K212wYUBZq3W_Rj8cXG_eqFpftR5LVlPlMrjil8fnWpB_c8gAqBg0saZJiIuNIxTuKba0oLnyXRXXUWOgBHiPKkLo0Vtzuz49nL_NOne2rlwwnC6SZOqkGDvN8Q1tO4HxK0sZWUCFcFSv-dGg6O3zfMAp8 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:07.324568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_036a12fe0a6540fbaa3067164720e8a9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/036a12fe0a6540fbaa3067164720e8a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 036a12fe0a6540fbaa3067164720e8a9 Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesNegativeTest-157899297 Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5258fe7f2ac34691859ee5da42fbf7c8 Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesNegativeTest-157899297-project Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'ff14914b-d9b1-4e6b-b556-db09f4552ac0'} Aug 07 12:22:07.325728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. (HTTP 404) (Request-ID: req-72430c2b-9a8c-4212-a25e-ca3ceb745a88) Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.326507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:22:07.327503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 12:22:07.329384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb3d5a80-ca6a-4aad-948d-9983bbcf282b tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] Returning 404 to user: Volume ff14914b-d9b1-4e6b-b556-db09f4552ac0 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fb3d5a80-ca6a-4aad-948d-9983bbcf282b tempest-VolumesNegativeTest-157899297 tempest-VolumesNegativeTest-157899297-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ff14914b-d9b1-4e6b-b556-db09f4552ac0" status: 404 len: 109 microversion: 2.1 time: 0.074153 Aug 07 12:22:07.331877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 25/39] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:22:07 2022] GET /compute/v2.1/os-volumes/ff14914b-d9b1-4e6b-b556-db09f4552ac0 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:22:07.344728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:07.345360 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:07.352669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:07.353107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:07.353554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:07.354276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:07.354890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:07.355297 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:07.549100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:22:07.549857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:22:07.550332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:22:07.550903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:22:07.553485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:22:07.590631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:07.595572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:07.595572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:07.595572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:07.595572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:07.596423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:07.673682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for project 547ebf661b1b48f289d734a71b494889. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:22:07.678987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for user c8fb20cfc3b6479198059b4383f47527 and project 547ebf661b1b48f289d734a71b494889. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:22:07.693901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:22:07.696841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:22:07.914060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-85577d83-c4d9-4c81-9a6f-5ade9c3b8690 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.034361 Aug 07 12:22:07.919102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 15/40] 10.222.0.30 () {62 vars in 1188 bytes} [Sun Aug 7 12:22:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 12:22:07.936221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:07.937484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:08.047327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:08.060574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aac86d35-22d5-4a53-8759-c7480949311a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.720333 Aug 07 12:22:08.061254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 26/41] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:07 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:08.079639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:08.080510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:08.087818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:08.088525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:08.089272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:08.090311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:08.090918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:08.091516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:08.219170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:08.237008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:08.238708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:08.243563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-09da3819-ecf9-41d6-889c-fdaa8fae09a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1281 microversion: 2.20 time: 0.321554 Aug 07 12:22:08.246223 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 16/42] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:07 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:08.403792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:08.417592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ac7cf160-edf2-4142-ae9a-44bf2449d874 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1281 microversion: 2.1 time: 0.342036 Aug 07 12:22:08.419895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 27/43] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:08 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:09.083043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:09.084683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:09.119750 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:09.119750 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:09.122815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:09.127713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:09.128213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:09.129154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:09.269089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:09.269689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:09.442429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:09.449664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:09.463186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:09.467345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-509d8e09-d6df-4908-9db2-b9be13ed2c68 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1281 microversion: 2.20 time: 0.203489 Aug 07 12:22:09.473111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 28/44] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:09 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:09.491321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:09.499991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:09.518516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:09.522353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:09.525309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:09.527582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:09.530388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:09.531791 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:09.858529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:09.870814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b5056047-b161-42fd-9faf-456b80ccbd0c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1279 microversion: 2.1 time: 0.396286 Aug 07 12:22:09.881614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 29/45] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:09 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:09.998500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:10.039324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-11f75b85-f691-4a31-93f4-0f910a73d34a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.959794 Aug 07 12:22:10.043701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 17/46] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:09 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:10.507450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:10.508278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:10.516036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:10.516556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:10.517136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:10.517900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:10.518576 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:10.519393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:10.689219 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:10.705604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:10.707214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:10.712449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-72c5ef6b-191c-4bf5-ab6d-479a64dd4509 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1277 microversion: 2.20 time: 0.210296 Aug 07 12:22:10.713211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 30/47] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:10 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:10.897597 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:10.898541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:10.913817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:10.914868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:10.916093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:10.917868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:10.919553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:10.920260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.066236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:11.067190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:11.074785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=4 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:11.082815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.083726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.084693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.089079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:11.098194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.098194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.098194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.100443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bb14ffdf-2f22-4dfe-9eda-2c1a799a7580 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1279 microversion: 2.1 time: 0.209977 Aug 07 12:22:11.101294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 18/48] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:10 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:11.555425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dced0f9-737b-499f-bb9a-b40e0c6ad570", "tag": "aecd27b3-6e36-457f-948c-a1aad43c3b4d"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:11.566145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.567306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.568943 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.603336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Creating event network-changed:aecd27b3-6e36-457f-948c-a1aad43c3b4d for instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 on hv-cinder-84984 Aug 07 12:22:11.606866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 12:22:11.608117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-e4bf158d-2bce-46fb-a860-582909d3cc60 req-0cfa38c1-9bc8-44b9-8cbf-27c78a14a24a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 12:22:11.610535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.611395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.618242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.618242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.618242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.618242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.627392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.compute.rpcapi [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 12:22:11.629131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] Releasing lock "compute-rpcapi-router" {{(pid=118243) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 12:22:11.667480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c0f2bb90-fe02-4c05-a64b-24dfe803314e None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371645 Aug 07 12:22:11.668516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 19/49] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:22:11.785758 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:11.806125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8a8a1299-0cbb-49c5-a64d-989c77f4b108 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.744122 Aug 07 12:22:11.807137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 31/50] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:11 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:11.829387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:11.834116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:11.851757 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.852246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.852679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:11.855037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:11.855545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:11.855973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.130095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "612dc648-62d5-4d0b-9f0a-c5c092085095", "tag": "bf3e4c47-b32d-4481-987f-3ef87429cf12"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:12.169353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:12.182565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:12.182565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:12.184798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.193947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:12.205157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:12.207363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-34acc3b4-4ddb-48ba-a876-ba1b40b3806a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1341 microversion: 2.20 time: 0.398849 Aug 07 12:22:12.208098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 32/51] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:11 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1341 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:12.238355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] Creating event network-changed:bf3e4c47-b32d-4481-987f-3ef87429cf12 for instance 612dc648-62d5-4d0b-9f0a-c5c092085095 on hv-cinder-84984 Aug 07 12:22:12.247467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:12.248075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:12.267610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-a7056c61-efed-4028-8d4c-a05a71b70b25 req-966ed659-618a-450b-ad32-0fe9d3dc7208 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.590438 Aug 07 12:22:12.268554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:12.269263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:12.269907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.270807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:12.272031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:12.272248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 20/52] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:22:12.272783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.832782 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:12.834438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:12.849929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:12.850904 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:12.851543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.853691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:12.854927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:12.857251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:12.864343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:12.875019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8b330ff3-ca68-4247-9020-fae1522e5fde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.630947 Aug 07 12:22:12.877083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 33/53] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:12 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:13.181935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:13.196393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-375ecda5-25b7-4eee-8296-688307bc9540 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.370154 Aug 07 12:22:13.197162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 21/54] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:12 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:13.236555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:13.241318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:13.246615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:13.247498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:13.248127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:13.249303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:13.249754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:13.250182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:13.316634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:13.330059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:13.331829 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:13.333124 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-173f8834-6e6d-4d5a-83eb-c48f0cec9d62 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.101761 Aug 07 12:22:13.334584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 34/55] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:13 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:13.715664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13feb920-dba3-4b48-a744-3c293f65c721", "tag": "12040d1e-600d-44ac-8ea2-ee33856531e1"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:13.738370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:13.739162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:13.739590 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:13.751286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] Creating event network-changed:12040d1e-600d-44ac-8ea2-ee33856531e1 for instance 13feb920-dba3-4b48-a744-3c293f65c721 on hv-cinder-84984 Aug 07 12:22:13.757300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-507c36da-92e6-45c6-a9fc-0ac5070f7371 req-a5f8dbe0-f86f-439a-b59b-c806575694ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045368 Aug 07 12:22:13.758456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 22/56] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:13.897746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:13.898366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:13.904299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:13.904781 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:13.908227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:13.908227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:13.908227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:13.908227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:14.050963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:14.062531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-72af657c-156a-4d94-9332-df1097b0a50d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.168084 Aug 07 12:22:14.063464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 35/57] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:13 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:14.218033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:14.218763 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:14.225626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:14.226241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:14.226686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:14.227423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:14.227994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:14.228621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:14.356344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:14.356956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:14.363341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:14.363831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:14.364261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:14.365286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:14.366072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:14.366628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:14.377220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:14.388861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9939b1f5-2c65-47e8-9fcd-48f1d145dd55 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.174815 Aug 07 12:22:14.389841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 23/58] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:14 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:14.434500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:14.443936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:14.445592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:14.446823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-228425ac-66b4-4bfb-ae3d-3de9f806d12d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.094364 Aug 07 12:22:14.447848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 36/59] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:14 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:15.084452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:15.085470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:15.093388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.093388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.093388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.093609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.093995 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.094408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.292732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:15.301102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-719e15de-d53d-4ad5-9207-32e6910b5b0d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.221448 Aug 07 12:22:15.301784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 24/60] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:15 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:15.409865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:15.410489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:15.425045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.425675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.426130 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.426850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.427381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.428085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.470167 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:15.470924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:15.481144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.481144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.481144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.481144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:15.481446 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:15.481446 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:15.568599 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:15.593136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:15.598074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:15.599950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-93aff71f-16b0-46aa-993a-289f4e09c083 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.133324 Aug 07 12:22:15.604342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 25/61] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:15 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:15.633680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:15.650587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ef11cd1e-1b7a-411b-8798-0f13d2e2e65a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.243379 Aug 07 12:22:15.650587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 37/62] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:15 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:16.327702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:16.328442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:16.336268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.337008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.337603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.338512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.339313 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.339895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.496801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:16.510419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f1563f47-7bc7-42b9-96b8-a2f2e76727d8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.183326 Aug 07 12:22:16.510419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 26/63] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:16 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:16.622463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:16.623969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:16.639818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.640715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.641297 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.642158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.642839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.655348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.670173 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:16.670793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:16.677273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.678004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.678958 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.680522 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:16.681140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:16.681758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:16.733411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:16.736952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:16.744876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:16.747233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:16.756725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-86f99cb0-27a2-4e70-bb39-9e43f20d573f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.138102 Aug 07 12:22:16.757697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 38/64] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:16 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:16.892920 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:16.901364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-26db23f0-6fe0-4f8f-b9ae-c2d3f41c2312 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.235523 Aug 07 12:22:16.903050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 27/65] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:16 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:17.529797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:17.530404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:17.537736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.538224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.538657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:17.539383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.539831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.540249 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:17.778229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:17.782417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:17.783126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:17.788940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9ef9d298-673d-41c3-a8b3-71d110597ffe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.262911 Aug 07 12:22:17.792544 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.793044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.793467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:17.794180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.794640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.795092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:17.803701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 39/66] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:17 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:17.930390 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:17.933579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:17.936719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:17.942650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:17.945520 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:17.948853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-43980acc-d6aa-4891-941c-5566855097a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.170313 Aug 07 12:22:17.949875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.950031 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 28/67] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:17 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:17.950738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.951222 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:17.956029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:17.956029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:17.956029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:18.200541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:18.216994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1cb60535-f21f-443a-a654-b564751f07d3 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.289723 Aug 07 12:22:18.217649 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 40/68] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:17 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:18.814574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:18.816353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:18.831070 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=22 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:18.833974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:18.835099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:18.836366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:18.837323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:18.838079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:18.838702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:18.976229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:18.976841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:18.984357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:18.985907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:18.986396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:18.986847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:18.987604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:18.988048 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:18.989422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:19.034719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:19.048724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dc4d46e8-d54a-4012-af20-3c4b37ec1044 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.240337 Aug 07 12:22:19.064784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 29/69] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:18 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:19.104375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:19.117326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:19.120048 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:19.121847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c61337ff-ad0c-4d50-833b-87114acc9070 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.149789 Aug 07 12:22:19.123861 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 41/70] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:18 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:19.239411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:19.244052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:19.254160 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:19.258904 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:19.260531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:19.272474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:19.287770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:19.288511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:19.548440 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:19.557526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3c074b87-9ba0-4bbd-b33f-85b14e05452d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.322299 Aug 07 12:22:19.571676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 30/71] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:19 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:20.075572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:20.076284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:20.078567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=20 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:20.084160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.084769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.085209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.085921 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.086373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.086836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.148809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:20.149497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:20.156445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.156946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.157384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.158092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.158541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.159941 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.230097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:20.240196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:20.241942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:20.243322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-07fdc681-96e0-4672-9210-605b1b1b42bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.099327 Aug 07 12:22:20.244494 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 31/72] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:20 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:20.252098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:20.261188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ca20f1f5-7370-4c65-9a6c-4ed4f327520d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.190715 Aug 07 12:22:20.261891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 42/73] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:20 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:20.577807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:20.578412 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:20.585014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.585502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.585986 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.586661 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:20.587139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:20.587628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:20.720282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:20.728065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-370a4f17-b9b1-4875-9e0d-c5ea55684afb tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.154078 Aug 07 12:22:20.742707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 32/74] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:20 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:21.266199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:21.267533 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:21.276808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.279855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.281068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.282337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:21.283507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:21.284442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.284981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.287030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.299794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.301465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.306497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.309150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.309150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.309150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.386789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:21.395672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:21.397324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:21.398449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-09d3ab52-2df9-4105-b63f-35a3af94c68d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1339 microversion: 2.20 time: 0.136348 Aug 07 12:22:21.399220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 43/75] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:21 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:21.581973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:21.596501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d71ddfff-45bb-4ad5-9958-02591998d824 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.318440 Aug 07 12:22:21.597210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 33/76] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:21 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:21.751327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:21.757375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:21.761545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.762052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.762495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.763439 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:21.764172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:21.764693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:21.999220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:22.009846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ff61d40c-1806-42bc-b5ab-4366ce33cc9e tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.264328 Aug 07 12:22:22.013836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 44/77] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:21 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:22.421081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:22.421715 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:22.423632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:22.428920 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:22.429401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:22.429836 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:22.430537 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:22.430989 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:22.431435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:22.451342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:22.589427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:22.598411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:22.600534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:22.602287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-64169d83-76ee-4012-9dca-42449c708f04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.184999 Aug 07 12:22:22.602868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 34/78] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:22 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:22.619280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:22.619740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:22.627062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:22.627622 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:22.628256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:22.628883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:22.629334 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:22.629788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:22.829335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:22.836686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-28673e81-b5a7-40eb-8248-74f9fa01fa83 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.223637 Aug 07 12:22:22.837472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 45/79] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:22 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:23.033428 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:23.038489 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:23.038489 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:23.044375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.045108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.045700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.046743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.047405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.048007 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.329516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:23.337400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cb1b4584-1574-4cc2-a997-307eac65db9f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.307955 Aug 07 12:22:23.339154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 35/80] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:23 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:23.628295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:23.629004 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:23.639848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.641678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.642748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.646762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.646762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.647188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.857997 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:23.865995 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:23.873152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.873652 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.874209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.878631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:23.878631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:23.886282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:23.976729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:23.985948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:23.988046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:23.990088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-181a21b1-6bd5-4535-b34c-8f173dad3967 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.367458 Aug 07 12:22:23.991433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 46/81] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:23 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:24.004798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:24.075492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:24.075492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:24.075492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:24.117352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Creating event network-changed:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:22:24.117880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 07 12:22:24.118279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20490490-6831-4d28-8e3d-e38b07b55d9c req-53a0543f-c742-4407-a588-3532532a8b98 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 07 12:22:24.131854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:24.132410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:24.132866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:24.133726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:24.134287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:24.135049 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:24.154432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.compute.rpcapi [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 07 12:22:24.154909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118242) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 07 12:22:24.203979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5f58a554-7be8-498c-8899-afd3e5f304a9 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210937 Aug 07 12:22:24.205005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 47/82] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:24.358591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:24.361514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:24.376894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:24.377672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:24.378264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:24.379199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:24.384706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:24.384706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:24.655885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:24.671438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7d07002f-0d0e-4106-a55a-1e4eba83be50 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.317266 Aug 07 12:22:24.686071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 48/83] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:24 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:24.922092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:24.930141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-49fd8d51-6ae5-461a-82f8-8bfe3dec082c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 1.076240 Aug 07 12:22:24.931638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 36/84] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:23 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:25.014591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:25.015246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:25.023017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.024149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.024595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:25.025670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.026862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.027555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:25.263886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:25.277175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:25.280425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:25.282362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-980b4aa2-5b99-4153-91b6-cb607a154393 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.271461 Aug 07 12:22:25.283267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 49/85] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:25 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:25.704860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:25.705453 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:25.711582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.716874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.716874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:25.716874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.716874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.717346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:25.875952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:25.886246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ec311445-eca2-4179-94a4-067392802bde tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.186154 Aug 07 12:22:25.890989 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 37/86] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:25 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:25.950969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:25.951585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:25.957603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.958067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.959242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:25.959942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:25.960714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:25.969545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:26.275856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:26.285503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-82684a04-6360-480d-9058-64a74c273776 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.338369 Aug 07 12:22:26.301306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 50/87] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:25 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:26.306311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:26.307093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:26.313323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:26.316128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:26.316685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:26.318907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:26.319776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:26.323221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:26.714317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:26.722474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:26.734392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:26.735840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fcb213fd-e9e2-4521-950a-1ce698852295 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.434516 Aug 07 12:22:26.736600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 38/88] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:26 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:26.837793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dced0f9-737b-499f-bb9a-b40e0c6ad570", "name": "network-vif-plugged", "status": "completed", "tag": "aecd27b3-6e36-457f-948c-a1aad43c3b4d"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:26.847387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:26.847936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:26.848321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:26.859730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] Creating event network-vif-plugged:aecd27b3-6e36-457f-948c-a1aad43c3b4d for instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 on hv-cinder-84984 Aug 07 12:22:26.865734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-b31fcba2-9d6a-4b2b-87e2-12256644fb0f req-d7a68b59-5406-4327-81d8-d79bababf09e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270004 Aug 07 12:22:26.866464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 51/89] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:26.908154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:26.908771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:26.915191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:26.915676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:26.916110 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:26.916803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:26.917307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:26.917728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:27.054423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:27.063337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ec6197a3-23ea-4ff8-aad9-20cb2fc6b738 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.159014 Aug 07 12:22:27.064701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 39/90] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:26 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:27.316084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:27.317463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:27.340268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:27.340764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:27.341194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:27.341892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:27.346905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:27.348721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:27.526129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:27.533618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b2775326-b540-4e8d-acf3-3b523fae4668 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.222624 Aug 07 12:22:27.534187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 52/91] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:27 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:27.761175 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:27.761777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:27.768428 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:27.769231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:27.769661 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:27.771179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:27.771819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:27.772472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.088895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:28.089839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:28.108754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:28.109570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:28.110457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.113603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:28.114259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:28.116562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.335653 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:28.350892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6269d2a7-9744-4075-968f-8f3fe076b813 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.269764 Aug 07 12:22:28.352596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 53/92] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:28 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:28.554865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:28.555579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:28.561707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:28.562189 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:28.562617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.563380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:28.563823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:28.564421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.637933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:28.646766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:28.654163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:28.655577 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e249b02c-cd2b-411c-ada9-eeef01fb316b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.898889 Aug 07 12:22:28.672223 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 40/93] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:27 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:28.777660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:28.786126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a33e13ce-677a-485b-968f-6926f714f022 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.235643 Aug 07 12:22:28.786766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 54/94] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:28 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:28.888111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612dc648-62d5-4d0b-9f0a-c5c092085095", "name": "network-vif-plugged", "status": "completed", "tag": "bf3e4c47-b32d-4481-987f-3ef87429cf12"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:28.897687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:28.898172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:28.898606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:28.916744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] Creating event network-vif-plugged:bf3e4c47-b32d-4481-987f-3ef87429cf12 for instance 612dc648-62d5-4d0b-9f0a-c5c092085095 on hv-cinder-84984 Aug 07 12:22:28.922691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-cae4fe40-cad7-4f4b-a8f3-3ce90e616771 req-eb3521ec-e238-4dfb-b392-6d520d765403 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040703 Aug 07 12:22:28.924233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 41/95] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:29.378240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:29.378854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:29.386143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.386627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.388704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.388704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.388704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.388704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.605034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:29.615443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b33c3a4c-f20e-42c8-82ef-cd2c6b99385d tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.241146 Aug 07 12:22:29.628263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 55/96] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:29 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:29.695994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:29.696976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:29.708924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.710484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.710484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.711370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.712047 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.712670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.810700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:29.811515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:29.820845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.821868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.823389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.824605 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:29.825646 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:29.826490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:29.858642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:29.917672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:29.948813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:29.948813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:29.948813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-66c4c854-e9ec-473e-b099-1091acc388c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.257873 Aug 07 12:22:29.960136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 42/97] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:29 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:30.099721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:30.112739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ecc49fdf-66dc-4114-ad73-e8f92b2e7d4b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.308058 Aug 07 12:22:30.113503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 56/98] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:29 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:30.637181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:30.637838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:30.643820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:30.644292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:30.644723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:30.645412 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:30.645860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:30.646279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:30.781253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:30.794658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-889256cf-04bf-44e0-9dce-d35103408e20 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1315 microversion: 2.1 time: 0.157440 Aug 07 12:22:30.794658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 43/99] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:30 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:30.939678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13feb920-dba3-4b48-a744-3c293f65c721", "name": "network-vif-plugged", "status": "completed", "tag": "12040d1e-600d-44ac-8ea2-ee33856531e1"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:30.949559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:30.950152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:30.950652 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:30.961630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] Creating event network-vif-plugged:12040d1e-600d-44ac-8ea2-ee33856531e1 for instance 13feb920-dba3-4b48-a744-3c293f65c721 on hv-cinder-84984 Aug 07 12:22:30.967348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-3ba01d40-a404-4394-b5ee-c32b9e02d583 req-5dfd7467-c605-4ae5-bb32-b3082746aba0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031927 Aug 07 12:22:30.968397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 57/100] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:30.972653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:30.977586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:30.980178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:30.980773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:30.981210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:30.981897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:30.982342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:30.982760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:31.136017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:31.137136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:31.140549 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:31.144083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:31.144814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:31.145404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:31.146457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:31.147136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:31.150343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:31.151282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:31.153382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:31.155121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6910ec87-4025-4e55-b3ea-0cd669ed5c88 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.187020 Aug 07 12:22:31.167862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 44/101] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:30 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:31.306189 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:31.313665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c174e73c-0433-4295-a1e6-1264e5df9267 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.182319 Aug 07 12:22:31.314509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 58/102] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:31 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:31.817068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:31.818770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:31.830838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:31.835940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:31.835940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:31.835940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:31.835940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:31.836395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:32.120129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:32.127839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4db9e88b-ba1e-4296-b4f7-39eaa511ca25 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1501 microversion: 2.1 time: 0.320201 Aug 07 12:22:32.128196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 45/103] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:31 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:32.179049 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:32.180215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:32.186763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:32.187281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:32.187723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:32.188428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:32.188894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:32.189306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:32.336810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:32.339192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:32.351793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:32.352422 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:32.352871 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:32.355879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:32.355879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:32.355879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:32.437917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:32.447385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:32.449035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:32.450109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-eb64d7ae-22a6-4b56-a16c-588e3aae3523 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.275280 Aug 07 12:22:32.451064 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 59/104] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:32 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:32.611854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:32.625233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-60f23325-c982-43e5-bb8f-8fc1c97e20fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.289287 Aug 07 12:22:32.627423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 46/105] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:32 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:32.983441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "name": "network-vif-plugged", "status": "completed", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:32.993258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:32.993730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:32.994155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:33.005507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] Creating event network-vif-plugged:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:22:33.011092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-13817713-2f82-4c46-ab64-3c59a9c010b1 req-8c477804-c694-4665-a281-9f4a35459594 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Aug 07 12:22:33.011741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 60/106] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:33.478253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:33.479511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:33.488529 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:33.495408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:33.496240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:33.497792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:33.498546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:33.499207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:33.641572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:33.642417 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:33.656354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:33.657106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:33.657611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:33.658385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:33.660591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:33.661943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:33.682431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:33.693214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:33.695135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:33.696387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7bbe7fd2-3778-498d-a691-1bc2dbfd2259 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.222773 Aug 07 12:22:33.697322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 47/107] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:33 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:22:33.865963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:33.883612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8f612e17-ce32-4c53-8e53-1869d0de6a6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1321 microversion: 2.1 time: 0.246313 Aug 07 12:22:33.895076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 61/108] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:33 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:34.260460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78f448bc-b573-4f0b-b591-9f5c59fb6fb1"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:34.262962 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:34.268873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.269354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.269789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:34.271098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.271722 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.272365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:34.718785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:34.719421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:34.721394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:34.726667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.727349 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.727879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:34.730923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.730923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.730923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:34.863302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:34.872118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:34.873617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:34.874900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-43d0a15e-4b54-42f0-866f-61ccde4463cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.160052 Aug 07 12:22:34.875501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 62/109] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:34 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:34.905841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:34.906444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:34.913172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.913705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.914153 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:34.914835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:34.915312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:34.915729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.088883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:35.098595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fa62931c-4649-4ecb-babd-209bc98de1fe tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1516 microversion: 2.1 time: 0.196520 Aug 07 12:22:35.099377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 63/110] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:34 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:35.133821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:35.140697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:35.156577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.158258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.158711 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.160848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.162755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.164751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.244023 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'flavor' on Instance uuid 13feb920-dba3-4b48-a744-3c293f65c721 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:22:35.684735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7527e073-c2b4-49e4-95ac-45b06f8c9bcf tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721/action" status: 200 len: 32 microversion: 2.1 time: 0.565995 Aug 07 12:22:35.685407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 64/111] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:22:35 2022] POST /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721/action => generated 32 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:22:35.695850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:35.697518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:35.704902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.705387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.705899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.706833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.707307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.708059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.844853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1e7aba54-2793-417d-8a39-8c61de41557f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "POST /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.583349 Aug 07 12:22:35.844853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 48/112] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:22:34 2022] POST /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570/os-volume_attachments => generated 194 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:35.898723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:35.899482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:35.912464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.913431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.914084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:35.915079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:35.915683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:35.916332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:36.078278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:36.086371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-15d88988-c867-4018-890d-d71e5fda80e4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.395278 Aug 07 12:22:36.091350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 65/113] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:35 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:36.188279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:36.196784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:36.198374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:36.199928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-77e8742c-b44e-4b75-be5f-ef74a27581e8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1406 microversion: 2.20 time: 0.305548 Aug 07 12:22:36.200551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 49/114] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:35 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:37.106824 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:37.108086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:37.114336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.115194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.115799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.116581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.118154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.118154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.222936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:37.227094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:37.235935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.236454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.236916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.237615 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.238065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.238484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.263727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:37.273285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-59c4e713-78c4-41b8-b5fd-fbc4ec586ae2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.170294 Aug 07 12:22:37.274095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:37.274224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 66/115] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:37 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:37.426837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:37.436238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:37.437788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:37.439380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-57c15503-4a32-4ce6-b5fd-cc51e3b1219a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1598 microversion: 2.20 time: 0.220951 Aug 07 12:22:37.443913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 50/116] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:22:37 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1598 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:22:37.462423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:37.462916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:37.468913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.469393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.469833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.470744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:37.471228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:37.471802 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:37.560972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-342c9a97-fc5e-4f6d-922d-cca5248546fb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103395 Aug 07 12:22:37.561747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 67/117] 10.222.0.30 () {60 vars in 1316 bytes} [Sun Aug 7 12:22:37 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:22:38.293773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:38.294987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:38.314353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:38.314353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:38.314353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:38.314353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:38.314662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:38.314662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:38.516454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:38.526840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ca8ee6d1-94f9-4c7d-9861-e2936abe043e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.235615 Aug 07 12:22:38.527374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 51/118] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:38 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:39.125611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:39.150694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:39.151670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:39.152365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:39.168651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] Creating event network-changed:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:22:39.174818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-dd0f1221-ea26-44f8-a376-a06250481c56 req-5eb65cec-4831-4b67-a9bb-97a85642d791 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075228 Aug 07 12:22:39.176267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 68/119] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:39.550421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:39.551397 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:39.559456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:39.567193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:39.568124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:39.569132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:39.569796 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:39.570532 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:40.077990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:40.086212 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ccd1fec1-d69e-4d72-b7ab-0a367231203b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.541789 Aug 07 12:22:40.086974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 52/120] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:39 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:41.108215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:41.109092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:41.121383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:41.121890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:41.122337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:41.123141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:41.123780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:41.125434 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:41.463585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:41.480599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f2724864-393e-40be-ac52-24533145bdde tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.376513 Aug 07 12:22:41.483952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 69/121] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:41 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:42.508690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:42.509355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:42.518857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:42.519431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:42.519865 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:42.521673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:42.522136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:42.522563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:42.693649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:42.701674 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d4f4f359-d749-4a39-b778-c22df656ab10 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.197696 Aug 07 12:22:42.711728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 53/122] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:42 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:43.723459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:43.724864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:44.020462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:44.020462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:44.020462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:44.020462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:44.022805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:44.022805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:44.022805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:44.023419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aa33f740-cc9c-46f3-b7b0-8a545ea884c1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.290942 Aug 07 12:22:44.023419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 70/123] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:43 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:45.032446 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:45.033050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:45.040606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:45.041658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:45.042297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:45.043217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:45.043822 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:45.044824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:45.275640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:45.281588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2c1a18fe-018b-4dc2-8453-d96151469df7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.253547 Aug 07 12:22:45.295982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 54/124] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:45 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:45.784489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:45.789208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:45.799015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:45.799525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:45.800170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:45.800685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:45.801132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:45.802301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:45.862900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:22:46.049686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:46.207618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a96c9d11-cf43-4555-866d-a4a7c0fd3cdc tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 204 len: 0 microversion: 2.1 time: 0.426746 Aug 07 12:22:46.213540 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 71/125] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:22:45 2022] DELETE /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:22:46.219464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:46.220069 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:46.227423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:46.227608 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:46.228159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:46.228870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:46.229358 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:46.229741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:46.304885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:46.306120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:46.330920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:46.332505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:46.334009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:46.340771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:46.342339 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:46.343155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:46.424572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:46.433317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4245c46f-ea18-4e81-bffd-378167b72f12 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1553 microversion: 2.1 time: 0.217746 Aug 07 12:22:46.433895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 55/126] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:46 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:46.536154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:46.544243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c2f1e527-4bf3-448f-9c4b-6c24ba99435b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.245612 Aug 07 12:22:46.544822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 72/127] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:46 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:47.462845 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:47.466813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:47.470329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:47.471019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:47.471543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:47.472460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:47.473109 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:47.474162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:47.566966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:47.568543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:47.576589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:47.577465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:47.577972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:47.578908 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:47.579388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:47.580007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:47.721476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:47.730810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-819c01bb-b4d0-4701-b12a-f243a02d455a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1553 microversion: 2.1 time: 0.279448 Aug 07 12:22:47.731551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 56/128] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:47 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:47.766211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:47.773437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6c7305b8-c18e-4d94-b853-f47a7ed49474 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.211782 Aug 07 12:22:47.775088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 73/129] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:47 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:48.753691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:48.754306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:48.763242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:48.763952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:48.764562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:48.766550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:48.767697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:48.768409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:48.797040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:48.797643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:48.809825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:48.810330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:48.810772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:48.811513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:48.811964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:48.812385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:48.995229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:49.005002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5ade9277-ad11-4918-9291-3e4ec0c3d392 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.213086 Aug 07 12:22:49.018923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 74/130] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:48 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:49.056629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:49.064921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-15b9de33-71dd-4e89-be5b-d88bb2d2e52a tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1553 microversion: 2.1 time: 0.314983 Aug 07 12:22:49.071779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 57/131] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:48 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:50.026741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:50.027303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:50.033913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:50.034332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:50.034767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:50.035504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:50.036007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:50.042307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:50.086041 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:50.101126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:50.118531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:50.119281 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:50.119859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:50.120730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:50.121325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:50.121915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:50.220225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:50.228347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-93be7526-823b-45c1-b3d5-fd6465cde308 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.205425 Aug 07 12:22:50.230357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 75/132] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:50 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:50.403220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:50.412751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0e781da5-0e7c-4491-bbce-d262f49783d9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1553 microversion: 2.1 time: 0.330878 Aug 07 12:22:50.413351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 58/133] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:50 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:51.251502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:51.252160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:51.263273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:51.265015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:51.265364 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:51.268532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:51.269024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:51.269473 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:51.435236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:51.436062 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:51.456085 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:51.458330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:51.458889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:51.459909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:51.460566 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:51.461196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:51.564270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:51.572428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-88609f47-9f7e-4a41-8aa3-d956f05b781e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.325243 Aug 07 12:22:51.573608 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 76/134] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:51 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:52.048365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:52.064684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-858102df-4544-4395-b80e-a139c6b50db8 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1553 microversion: 2.1 time: 0.633758 Aug 07 12:22:52.068695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 59/135] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:51 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1553 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:52.596052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:52.597446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:52.605508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:52.606194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:52.606850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:52.607637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:52.608307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:52.608801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:52.756339 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:52.766125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9f92fd30-18bf-4be0-9831-892dcfaf5a4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.176245 Aug 07 12:22:52.777386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 77/136] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:52 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:52.993010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dced0f9-737b-499f-bb9a-b40e0c6ad570", "name": "network-vif-deleted", "tag": "aecd27b3-6e36-457f-948c-a1aad43c3b4d"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:53.003820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:53.004305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:53.004774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:53.026188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] Creating event network-vif-deleted:aecd27b3-6e36-457f-948c-a1aad43c3b4d for instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 on hv-cinder-84984 Aug 07 12:22:53.032521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-69c36bab-4dd3-405c-86aa-18533cd2ebbf req-816a29fd-40f4-4a19-bf80-9cede55350b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043165 Aug 07 12:22:53.033730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 60/137] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:53.088945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:53.090059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:53.091729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:53.099698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:53.100422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:53.100864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:53.101567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:53.102105 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:53.102520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:53.207490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:53.222939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-14f8dc68-7adc-40ba-bbbf-7fe1f7f7d546 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1511 microversion: 2.1 time: 0.140947 Aug 07 12:22:53.224672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 78/138] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:53 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:53.800018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:53.808196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:53.820630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:53.821441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:53.822492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:53.823554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:53.824188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:53.825808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:54.198673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:54.206246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6637043b-2874-4df3-be6e-86ae1eca7f33 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.423025 Aug 07 12:22:54.206811 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 61/139] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:53 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:54.245639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:54.246250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:54.252822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:54.253300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:54.253729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:54.254437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:54.255169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:54.255590 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:54.320714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:54.330450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dedcbf43-54e5-415d-9e97-eed686db243f tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1511 microversion: 2.1 time: 0.086927 Aug 07 12:22:54.330450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 79/140] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:54 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:55.159488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0096065a-d1fb-450b-8d0c-9759ab93bc3e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Action: 'create', calling method: .version_select at 0x7f77a429f280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1783280060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFf+j+Z8zbUuYTtztzBAvPLEIWMqhtzAu0PxYOuLZ2ncVwlb0Ip3zf7vpq35rr/h/9PxBRUaJwhY99z1fl4AdKdZuTabbmhp/SiHrkQrjtXr2+XAXR4BT5AzZbLpTDeNA=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:22:55.176227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-0096065a-d1fb-450b-8d0c-9759ab93bc3e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Getting quotas for project c879759a492b427d99fea0ed4f410908. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:22:55.181985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-0096065a-d1fb-450b-8d0c-9759ab93bc3e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Getting quotas for user f3b0a65629074281bd0ac256bf4c5ce8 and project c879759a492b427d99fea0ed4f410908. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:22:55.228318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:55.228961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:55.235020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:55.235506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:55.235936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:55.236619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:55.237067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:55.237515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:55.269064 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0096065a-d1fb-450b-8d0c-9759ab93bc3e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.349974 Aug 07 12:22:55.269714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 62/141] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:22:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:22:55.351215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:55.352063 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:55.359410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:55.360133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:55.360566 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:55.361251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:55.361690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:55.362349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:55.389710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:55.417493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ec0ccfc2-c262-4487-acd0-01b757a6c240 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.193936 Aug 07 12:22:55.429732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 80/142] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:55 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:55.471303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:55.485795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c73e3fd7-0ec4-407c-add7-28c2e82b3a47 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1511 microversion: 2.1 time: 0.139477 Aug 07 12:22:55.488048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 63/143] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:55 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1511 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:56.441646 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:56.443274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:56.454732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:56.459825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:56.459825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:56.459825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:56.459825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:56.461310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:56.512582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:56.513118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:56.533599 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:22:56.556487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:56.557009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:56.559739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:56.560490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:56.560952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:56.584627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:56.759499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:56.778991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2e22a2ea-58d4-429f-8de5-3652cc04dca9 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1346 microversion: 2.1 time: 0.261790 Aug 07 12:22:56.778991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 64/144] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:56 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1346 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:56.865267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:56.873464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1dbe5ab9-b3fa-455c-a166-e99f732a3236 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.436018 Aug 07 12:22:56.874230 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 81/145] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:56 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:57.790058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:57.793293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:57.798121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:57.798658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:57.799125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:57.799829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:57.800276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:57.800724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:57.836618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:57.837117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:57.837718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:57.838143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lazy-loading 'fault' on Instance uuid 0dced0f9-737b-499f-bb9a-b40e0c6ad570 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:22:57.909101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:57.909710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:57.922556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:57.923087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:57.923426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5401baffbd794016b01d109e8e2529ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5becdfe9ba3b48d5b11668d6eeec33a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:57.923555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:57.924218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:57.924848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:57.925428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:57.937550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4e140686-7bc6-496b-81af-bc96a2a42874 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 200 len: 1351 microversion: 2.1 time: 0.149036 Aug 07 12:22:57.947560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 65/146] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:57 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:22:58.183953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:58.191282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dc6027ec-8580-4943-98a5-7cebb705ead7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.285970 Aug 07 12:22:58.191893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 82/147] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:57 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:22:58.965138 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:58.965138 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:58.969999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:58.970116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:58.970587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:58.972444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:58.973685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:58.974583 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:58.998617 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] HTTP exception thrown: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Request method failure captured: Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 HTTP/1.1 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765iz3jLz7GjDQlOyD_I0oLIUscB0Jf1FETqNOk2RPlLVegtRyjrFbKITT4aPE6wxMJNy8g1unu3tsnwOeLodRlqcAeOQqQsJqcfO5spkkBds05dBJKwRXv4xK85FC3Q8ADuwBz8RQhTESuWbknudS1SEj2LVMHopN_9wfUIA9qcYhs Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:22:59.011559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5becdfe9ba3b48d5b11668d6eeec33a4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 5401baffbd794016b01d109e8e2529ac Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.012998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '0dced0f9-737b-499f-bb9a-b40e0c6ad570'} Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:59.013700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.015076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.016901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Returning 404 to user: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:59.017541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d951b607-f728-4956-a297-f8b0318554b4 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 404 len: 111 microversion: 2.1 time: 0.061644 Aug 07 12:22:59.018133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 66/148] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:58 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:22:59.171031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:59.174141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:59.181124 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:59.181613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:59.182260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:59.182758 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:59.183468 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:59.183895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:59.199831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] HTTP exception thrown: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Request method failure captured: Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570/os-volume_attachments HTTP/1.1 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765iz3jLz7GjDQlOyD_I0oLIUscB0Jf1FETqNOk2RPlLVegtRyjrFbKITT4aPE6wxMJNy8g1unu3tsnwOeLodRlqcAeOQqQsJqcfO5spkkBds05dBJKwRXv4xK85FC3Q8ADuwBz8RQhTESuWbknudS1SEj2LVMHopN_9wfUIA9qcYhs Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:22:59.205994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5becdfe9ba3b48d5b11668d6eeec33a4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 5401baffbd794016b01d109e8e2529ac Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.208133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'server_id': '0dced0f9-737b-499f-bb9a-b40e0c6ad570'} Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:22:59.209433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:22:59.210597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:22:59.213923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:22:59.214565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Returning 404 to user: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:22:59.214692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:22:59.216305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-28d41ca0-fe92-4ae3-85e6-7f2fa39808c0 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050433 Aug 07 12:22:59.217421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 83/149] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:22:59 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570/os-volume_attachments => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:22:59.224866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:59.225362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:59.225945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:59.226654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:22:59.227256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:22:59.227578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:22:59.437510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:22:59.447158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-20135df1-d30d-4a43-a277-4f4d29c544c4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.238645 Aug 07 12:22:59.448283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 67/150] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:22:59 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:00.468258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:00.468909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:00.475558 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:00.476037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:00.476568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:00.477254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:00.477705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:00.478150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:00.606418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:00.614244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4f6859dc-ecae-4bb5-a7d7-a1550289e757 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.149629 Aug 07 12:23:00.614649 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 84/151] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:00 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:01.634307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:01.634911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:01.641576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:01.642119 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:01.642558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:01.643264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:01.643714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:01.644134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:01.773547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:01.784854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-08ba26c7-10fb-448c-b058-d7505e93a6de tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.150866 Aug 07 12:23:01.784854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 68/152] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:01 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:02.801916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:02.802609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:02.808660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:02.809191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:02.809626 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:02.810308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:02.810764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:02.811245 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:02.939622 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:02.947362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1ba9b4ba-54b5-430b-8b4b-78c1a3cdbd1c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.149414 Aug 07 12:23:02.947936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 85/153] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:02 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:03.968754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:03.969372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:03.976224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:03.981367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:03.981498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-897025587", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "networks": [{"uuid": "069fd451-f41e-4c1b-953e-cc6be62df051"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:03.981956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:03.981956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:03.981956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:03.981956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:03.983160 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:04.131853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:04.139806 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d721725c-1399-4cb3-974b-e86f71b8eb4e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.174946 Aug 07 12:23:04.143146 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 69/154] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:03 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:04.854060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:04.854556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:04.861708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:04.865923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:04.865923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:04.865923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:04.865923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:04.866249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:04.878935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] HTTP exception thrown: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Request method failure captured: Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: DELETE /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 HTTP/1.1 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765iz3jLz7GjDQlOyD_I0oLIUscB0Jf1FETqNOk2RPlLVegtRyjrFbKITT4aPE6wxMJNy8g1unu3tsnwOeLodRlqcAeOQqQsJqcfO5spkkBds05dBJKwRXv4xK85FC3Q8ADuwBz8RQhTESuWbknudS1SEj2LVMHopN_9wfUIA9qcYhs Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:23:04.880519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5becdfe9ba3b48d5b11668d6eeec33a4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 5401baffbd794016b01d109e8e2529ac Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.881922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '0dced0f9-737b-499f-bb9a-b40e0c6ad570'} Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:23:04.882708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.884346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.885955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Returning 404 to user: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:23:04.885955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e4c709fc-10c8-432d-bc48-a0a708655c90 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 404 len: 111 microversion: 2.1 time: 0.032478 Aug 07 12:23:04.885955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 70/155] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:23:04 2022] DELETE /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:23:04.892473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:04.893934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] [instance: 0dced0f9-737b-499f-bb9a-b40e0c6ad570] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:04.900297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:04.900754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:04.901191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:04.901897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:04.902352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:04.902777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:04.918290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] HTTP exception thrown: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Request method failure captured: Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 HTTP/1.1 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765iz3jLz7GjDQlOyD_I0oLIUscB0Jf1FETqNOk2RPlLVegtRyjrFbKITT4aPE6wxMJNy8g1unu3tsnwOeLodRlqcAeOQqQsJqcfO5spkkBds05dBJKwRXv4xK85FC3Q8ADuwBz8RQhTESuWbknudS1SEj2LVMHopN_9wfUIA9qcYhs Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:23:04.918774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5becdfe9ba3b48d5b11668d6eeec33a4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5becdfe9ba3b48d5b11668d6eeec33a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 5becdfe9ba3b48d5b11668d6eeec33a4 Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-DeleteServersTestJSON-393762667 Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 5401baffbd794016b01d109e8e2529ac Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-DeleteServersTestJSON-393762667-project Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.920372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '0dced0f9-737b-499f-bb9a-b40e0c6ad570'} Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:23:04.921149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. Aug 07 12:23:04.922509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:23:04.924396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] Returning 404 to user: Instance 0dced0f9-737b-499f-bb9a-b40e0c6ad570 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:23:04.924396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-01a609f6-b252-44c9-839d-9f4ae44555d6 tempest-DeleteServersTestJSON-393762667 tempest-DeleteServersTestJSON-393762667-project] 10.222.0.30 "GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570" status: 404 len: 111 microversion: 2.1 time: 0.031936 Aug 07 12:23:04.924396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 71/156] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:04 2022] GET /compute/v2.1/servers/0dced0f9-737b-499f-bb9a-b40e0c6ad570 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:23:05.162168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:05.163071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:05.169206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:05.169686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:05.170311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:05.171021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:05.171488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:05.171898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:05.191082 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=4 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:05.382277 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:05.392621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7fb8c990-bbe8-4343-a2f9-3b4d0d2e1a64 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.235055 Aug 07 12:23:05.408785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 72/157] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:05 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:06.415819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:06.416517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:06.434837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:06.435875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:06.436794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:06.437778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:06.438437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:06.439094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:06.624984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:06.633224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-72cef5c6-4fad-463b-bbf0-4763a6864a5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.223301 Aug 07 12:23:06.633795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 73/158] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:06 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:07.655396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:07.656038 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:07.663088 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:07.663645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:07.664079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:07.664782 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:07.665810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:07.665810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:07.826320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:07.836226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a8a85965-2620-4203-be6c-6b84e7bda999 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.184677 Aug 07 12:23:07.836820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 74/159] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:07 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:08.863893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:08.864889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:08.873165 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:08.873654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:08.874086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:08.874784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:08.875838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:08.876270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:09.046692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:09.059435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2b2f9b93-8909-403b-9ec8-a49f7ee5d3a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.205518 Aug 07 12:23:09.060018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 75/160] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:08 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:09.114474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] validate_networks() for [('069fd451-f41e-4c1b-953e-cc6be62df051', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:23:09.540136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:23:09.540552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:23:09.541018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:23:09.543343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:23:09.543343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:23:09.551888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:09.552372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:09.552798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:09.553570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:09.554183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:09.554635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:09.573532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Getting quotas for project 7bdb62eaaade46ffa205828d13dba7be. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:23:09.578462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Getting quotas for user b68f7224855a4cec81b664a2573d60f1 and project 7bdb62eaaade46ffa205828d13dba7be. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:23:09.597922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:23:09.601065 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:23:09.740166 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-798609ff-dde3-43a3-8069-48d16846b765 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.768448 Aug 07 12:23:09.741043 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 86/161] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:23:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:23:09.752629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8fdc026b-7270-45e3-bf61-7f38665a5f1f tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:09.753235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8fdc026b-7270-45e3-bf61-7f38665a5f1f tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:09.851712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8fdc026b-7270-45e3-bf61-7f38665a5f1f tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:09.858839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8fdc026b-7270-45e3-bf61-7f38665a5f1f tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1218 microversion: 2.1 time: 0.111004 Aug 07 12:23:09.859499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 76/162] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:09 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:10.080035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:10.080679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:10.086865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:10.087805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:10.088250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:10.092546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:10.092546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:10.092546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:10.233789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:10.242159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aa5cb0ad-0c8b-43e1-b6a1-b21439eea435 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.165985 Aug 07 12:23:10.242729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 87/163] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:10 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:10.880239 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:10.880869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:10.887704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:10.888218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:10.888651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:10.889347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:10.889796 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:10.890220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:10.950400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:10.957797 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-905cf71a-c395-41da-8ba5-05eaa1c8ee80 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1222 microversion: 2.1 time: 0.081407 Aug 07 12:23:10.958501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 77/164] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:10 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:11.264008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:11.265381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:11.270907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:11.271727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:11.272206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:11.272899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:11.273355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:11.273780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:11.441548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:11.453516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9d9b51cb-3930-4aa3-b78b-cffe1149310d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.193513 Aug 07 12:23:11.454096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 88/165] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:11 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:11.978709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:11.980471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:11.985799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:11.986306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:11.986733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:11.987454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:11.987901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:11.988323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:12.051924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:12.059660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3fe35206-90c3-42b2-a709-b7b5d2db71a7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1270 microversion: 2.1 time: 0.084933 Aug 07 12:23:12.060251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 78/166] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:11 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:12.474746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:12.475489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:12.481450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:12.482206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:12.482653 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:12.483434 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:12.484613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:12.485294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:12.648155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:12.652414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:12.659720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-982d01e0-2a5f-4f6c-bc0e-af812efb9478 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.186914 Aug 07 12:23:12.659983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 89/167] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:12 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:13.080684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:13.081239 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:13.088476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:13.088954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:13.089387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:13.090074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:13.090525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:13.090945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:13.166011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:13.173656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d4136d16-1a29-44fd-8740-68df207e2e12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1278 microversion: 2.1 time: 0.096879 Aug 07 12:23:13.174322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 79/168] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:13 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:13.677790 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:13.678408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:13.685248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:13.685742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:13.686177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:13.686900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:13.687385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:13.687808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:13.847922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:13.863041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a2573a69-bf0d-409e-8b70-9d6504f285b2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.189177 Aug 07 12:23:13.864296 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 90/169] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:13 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:14.195131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:14.195741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:14.202639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:14.203240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:14.207273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:14.208155 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:14.209569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:14.210141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:14.329690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:14.338484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bf834367-829d-40bd-bd97-4d4ea2902330 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1278 microversion: 2.1 time: 0.147621 Aug 07 12:23:14.339289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 80/170] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:14 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:14.886250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:14.887648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:14.893663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:14.894382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:14.895222 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:14.896519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:14.897358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:14.897939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:15.075833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:15.083941 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e45421b4-4aad-41e1-982b-b2483c164db2 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.202072 Aug 07 12:23:15.084874 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 91/171] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:14 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:15.361096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:15.361714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:15.371511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:15.372288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:15.372984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:15.373915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:15.374543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:15.375030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:15.478616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:15.487340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5f26c78d-03f6-438d-9f75-b73be3318ccd tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1278 microversion: 2.1 time: 0.131023 Aug 07 12:23:15.488858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 81/172] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:15 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:16.106323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:16.107882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:16.115956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:16.116688 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:16.117503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:16.118479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:16.119212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:16.120101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:16.348186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:16.357341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1c133fc9-b410-4670-b1d3-9a6a15d3f782 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.254846 Aug 07 12:23:16.358804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 92/173] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:16 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:16.516072 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:16.518192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:16.529447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:16.530089 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:16.530780 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:16.531707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:16.532327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:16.532895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:16.596158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:16.604705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-83f643e2-feec-4fe4-ac64-e75665101c32 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1288 microversion: 2.1 time: 0.099850 Aug 07 12:23:16.605843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 82/174] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:16 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:17.379708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:17.381479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:17.389627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:17.390510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:17.392740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:17.393526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:17.393999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:17.394439 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:17.625805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:17.626316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:17.638922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:17.647181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:17.648101 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:17.649105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:17.649804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:17.650450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:17.735458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:17.743692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:17.751587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-121a4e0a-eaf1-4391-8b38-9aa17efa6da0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.377165 Aug 07 12:23:17.759807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 93/175] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:17 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:17.760367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c58c75cf-732e-451e-b466-425920d0a8a6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1288 microversion: 2.1 time: 0.137292 Aug 07 12:23:17.761679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 83/176] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:17 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:18.162962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0ca8df9c-b141-47ee-9adb-8582c0b273a7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: .version_select at 0x7f77a4ce9310>, body: {"keypair": {"name": "tempest-keypair-215805402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxnFsVX2wqgNuL8J4D213/LyNRv8rz8YygoB95dTp/L6iZoa2X58lp+FdSPIZ1h1Rp+tIL+eqpu32lnXXMTMTnDRj4f0KrN/g/n6q3zWlBksELRPaUBXnq0v+9rdU/Fzg=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:18.196647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-0ca8df9c-b141-47ee-9adb-8582c0b273a7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:23:18.204750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-0ca8df9c-b141-47ee-9adb-8582c0b273a7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:23:18.303833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0ca8df9c-b141-47ee-9adb-8582c0b273a7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.323317 Aug 07 12:23:18.307715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 94/177] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:23:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:18.781701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:18.782332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:18.782691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:18.782783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:18.789428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:18.789931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:18.790487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:18.790602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:18.791120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:18.791583 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:18.792015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:18.795151 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:18.795525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:18.796261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:18.796718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:18.799695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:18.858377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:18.880809 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1bf734b0-9c1a-43c1-a054-cd308e87ec16 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1288 microversion: 2.1 time: 0.103009 Aug 07 12:23:18.881727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 95/178] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:18 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:18.970593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:18.978956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ad127f86-3cd1-425b-a19b-1ef1ff629d34 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.201264 Aug 07 12:23:18.979572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 84/179] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:18 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:19.907438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:19.908428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:19.910497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:19.920311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:19.921463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:19.922008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:19.922814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:19.923301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:19.923727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:19.998895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:20.001345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:20.002071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:20.007388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-51fe3e73-3c28-4188-b841-3ef91dc86647 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1276 microversion: 2.1 time: 0.108501 Aug 07 12:23:20.007972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 96/180] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:19 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:20.008641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:20.010221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:20.010859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:20.011965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:20.013051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:20.013645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:20.014271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:20.319405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:20.327816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5308ec5b-f62e-47dd-8b38-bfcedf7849da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.330956 Aug 07 12:23:20.328406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 85/181] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:19 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:21.029282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:21.030539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:21.039430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:21.040137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:21.040731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:21.041829 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:21.042430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:21.043354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:21.253731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:21.264851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9ceed2fb-0423-4c39-a42d-2c6ffbd51dc4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.239646 Aug 07 12:23:21.266009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 97/182] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:21 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:21.353881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:21.353881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:21.364094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:21.364693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:21.365197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:21.366035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:21.366648 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:21.367105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:21.590704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-416600369", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d3266-c358-4a1b-818a-9b2ef5a91e93"}], "security_groups": [{"name": "tempest-securitygroup--1674847589"}], "key_name": "tempest-keypair-215805402", "user_data": "}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:21.629599 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:21.644686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-23755562-76af-4c4a-8c87-39020c6e72da tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1522 microversion: 2.1 time: 0.298840 Aug 07 12:23:21.648563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 86/183] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:21 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:21.771606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] validate_networks() for [('722d3266-c358-4a1b-818a-9b2ef5a91e93', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:23:22.147502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd67a2c0-dbe5-4118-b57f-dc7f73877d08", "tag": "60e58be3-95b0-4385-be72-29086cd43dc3"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:22.159342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.159944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.160608 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.179596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] Creating event network-changed:60e58be3-95b0-4385-be72-29086cd43dc3 for instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 on hv-cinder-84984 Aug 07 12:23:22.186794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-63e6f2b7-fabf-41c6-8325-0082af48eccb req-e46df03d-21a2-43db-8f5c-88ffac5d1898 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043530 Aug 07 12:23:22.188086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 87/184] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:22.246973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:23:22.247678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:23:22.248183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:23:22.248599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:23:22.249007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:23:22.258796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.259596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.260177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.260855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.261551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.262156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.289265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:23:22.289799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:22.291814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:22.298770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:23:22.304876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.306042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.307547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.308753 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.309691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.310521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.311579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:23:22.314053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:23:22.437903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8a1b8809-9646-4fd2-a219-22bfa0efe5cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851509 Aug 07 12:23:22.440961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 98/185] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:23:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 07 12:23:22.453675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d0ceb40a-a988-4dce-9ffe-eb173dd96ec4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:22.454291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d0ceb40a-a988-4dce-9ffe-eb173dd96ec4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:22.570413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d0ceb40a-a988-4dce-9ffe-eb173dd96ec4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:22.579469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d0ceb40a-a988-4dce-9ffe-eb173dd96ec4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1240 microversion: 2.1 time: 0.129657 Aug 07 12:23:22.580051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 99/186] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:22 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1240 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:22.672197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:22.673238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:22.682092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.682888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.686523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.686523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.686523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.686523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.862260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:22.870039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:22.871422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3272f1a5-1f14-4ff9-936c-dcb9e12864b8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1502 microversion: 2.1 time: 0.203241 Aug 07 12:23:22.883243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 100/187] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:22 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:22.883419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:22.883419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cde5fa41-e944-460c-95e8-4915e759aad8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.596150 Aug 07 12:23:22.883419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 88/188] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:22 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:22.898780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:22.903897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:22.906005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.906494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.907024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:22.907750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:22.908202 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:22.908627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:23.062513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:23.075371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f0838f75-7514-41f3-8baf-daa2812a5a75 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1514 microversion: 2.1 time: 0.179585 Aug 07 12:23:23.075371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 101/189] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:22 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:23.604924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8ec02d1c-0083-45cc-aac3-0d72ace0cb64 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:23.606010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8ec02d1c-0083-45cc-aac3-0d72ace0cb64 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:23.676818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8ec02d1c-0083-45cc-aac3-0d72ace0cb64 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:23.686488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8ec02d1c-0083-45cc-aac3-0d72ace0cb64 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1240 microversion: 2.1 time: 0.089217 Aug 07 12:23:23.687777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 89/190] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:23 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:23.898735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:23.899378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:23.905530 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:23.906007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:23.906482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:23.907192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:23.907639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:23.908056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:24.043916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:24.052008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5340722d-f9d5-478e-a3c7-d16ca0225243 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.156665 Aug 07 12:23:24.052579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 102/191] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:23 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:24.709177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:24.709792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:24.717030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:24.717604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:24.718013 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:24.718701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:24.719190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:24.719642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:24.787047 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:24.794460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a4500a23-f91e-4859-b395-57ee721aa0fe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1244 microversion: 2.1 time: 0.089589 Aug 07 12:23:24.795062 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 90/192] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:24 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:25.073335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:25.073877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:25.079766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:25.081948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:25.081948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:25.081948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:25.081948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:25.082371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:25.230103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:25.237988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5aa07705-0066-448f-891f-e14edfe7b84b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.168604 Aug 07 12:23:25.238578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 103/193] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:25 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:25.816367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:25.817091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:25.824432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:25.824990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:25.825605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:25.826307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:25.826926 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:25.827726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:25.897603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:25.905070 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-beefea42-2d5b-416b-84b3-e6feb971f7ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1244 microversion: 2.1 time: 0.093076 Aug 07 12:23:25.905949 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 91/194] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:25 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:26.259606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:26.260218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:26.262310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:26.266969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:26.270305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:26.270305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:26.270305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:26.270305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:26.270853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:26.400620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:26.408112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-970e5a10-e122-48db-8d32-48ea8430061e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.153128 Aug 07 12:23:26.408708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 104/195] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:26 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:26.925837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:26.927169 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:26.933694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:26.934179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:26.934611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:26.935516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:26.936331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:26.936762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:27.007076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:27.014811 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-afb16b32-8959-462b-ba03-09915b3aa15f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1244 microversion: 2.1 time: 0.092988 Aug 07 12:23:27.015414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 92/196] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:26 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:27.430566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:27.431273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:27.437802 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:27.438286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:27.438726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:27.439454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:27.439912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:27.440334 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:27.691542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-192437841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1783280060", "security_groups": [{"name": "tempest-secgroup-smoke-242116255"}], "networks": [{"uuid": "9f852d04-b41c-4661-a873-ff5d649be908"}], "block_device_mapping_v2": [{"uuid": "5e1eaf2d-0af6-48cd-bbbe-a67d005aea51", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:27.798418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:27.806563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d78de97c-e539-4b0e-afaa-29c62f881456 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.380815 Aug 07 12:23:27.807261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 105/197] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:27 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:27.819532 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] validate_networks() for [('9f852d04-b41c-4661-a873-ff5d649be908', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:23:28.037906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:28.038673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:28.045726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.046317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.046831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.047621 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.048259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.048686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.120651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:28.128744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9c0c1d25-0232-4185-9d5f-7b772ad28bed tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1236 microversion: 2.1 time: 0.096616 Aug 07 12:23:28.130079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 106/198] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:28 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:28.230275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:23:28.231612 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:23:28.232116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:23:28.232835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:23:28.233250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:23:28.242426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.243193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.243792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.244523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.244969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.245394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.263028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Getting quotas for project c879759a492b427d99fea0ed4f410908. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:23:28.267726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Getting quotas for user f3b0a65629074281bd0ac256bf4c5ce8 and project c879759a492b427d99fea0ed4f410908. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:23:28.325983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:23:28.328081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e1eaf2d-0af6-48cd-bbbe-a67d005aea51',volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:23:28.784075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a7244924-e0ca-43c3-8074-f9264b1ff7d4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.096082 Aug 07 12:23:28.785014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 93/199] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:23:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:23:28.796582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e66d29cb-4b33-446b-ab83-61844b4d433d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:28.797925 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e66d29cb-4b33-446b-ab83-61844b4d433d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:28.829709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:28.830658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:28.838492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.839718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.842290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.843189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:28.843996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:28.845333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:28.880999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e66d29cb-4b33-446b-ab83-61844b4d433d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:28.889589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e66d29cb-4b33-446b-ab83-61844b4d433d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1088 microversion: 2.1 time: 0.096730 Aug 07 12:23:28.890175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 107/200] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:28 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:29.076094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:29.087650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ccdba7d9-696e-42f0-a43e-668788783f12 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.263024 Aug 07 12:23:29.088550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 94/201] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:28 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:29.152225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:29.153029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:29.158870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.159457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.160070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.160793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.161561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.162246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.234400 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:29.241569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2b5e878a-e975-4054-ac18-9e0c7b0051dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1310 microversion: 2.1 time: 0.093272 Aug 07 12:23:29.242177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 108/202] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:29 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:29.803766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:29.806083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:29.808009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:29.813171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.813649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.814077 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.814773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.815281 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.815701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.852457 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'flavor' on Instance uuid 612dc648-62d5-4d0b-9f0a-c5c092085095 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:23:29.911561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:29.912154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:29.921073 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.921670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.922221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.923106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:29.923700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:29.924312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:29.998475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:30.008087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-540fd036-c1cf-4a2d-a665-a8317f8cbce5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1138 microversion: 2.1 time: 0.102214 Aug 07 12:23:30.021481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 109/203] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:29 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:30.111751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:30.113687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:30.120458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.120935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.121373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.122074 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.122524 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.126406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.131784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:30.278309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:30.283885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f0e06316-d80e-43bb-8402-8992df88e379 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/action" status: 200 len: 32 microversion: 2.1 time: 0.491780 Aug 07 12:23:30.284798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 95/204] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:23:29 2022] POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:23:30.288443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-180cc230-2019-4300-89b1-cd29fdbab66a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.180378 Aug 07 12:23:30.289415 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 110/205] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:30 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:30.301050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:30.302878 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:30.304772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:30.305484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:30.310749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.311821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.312426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.313382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.314120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.314375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.314736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.315244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.315824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.316675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.317378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.318010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:30.470608 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:30.480318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7ebc02fa-dea8-48d3-843c-c67eeb1dfa44 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.189028 Aug 07 12:23:30.481008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 111/206] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:30 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:30.649450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:30.660546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-becd2425-8251-4891-bbf1-03a488755dbf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.372977 Aug 07 12:23:30.660546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 96/207] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:30 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:30.972358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a26c053-8ae7-4956-9ffa-ae344cea68e3", "tag": "6dfb8044-a614-4cd6-b9ed-d0187b469bdc"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:30.987133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:30.987949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:30.990851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.003314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] Creating event network-changed:6dfb8044-a614-4cd6-b9ed-d0187b469bdc for instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 on hv-cinder-84984 Aug 07 12:23:31.009212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-6e2a61e9-68a0-4a76-b491-464b7d69af8c req-607f1fea-1e09-4259-b4f5-9f88b458d4ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041105 Aug 07 12:23:31.010067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 112/208] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:31.029968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:31.029968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:31.037406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.038051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.038565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.039372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.039890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.040378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.109412 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:31.118103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2dd8f9a8-6ba6-4e61-aea8-1565539bb028 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1186 microversion: 2.1 time: 0.093234 Aug 07 12:23:31.118887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 97/209] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:31 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:31.311051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:31.311051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:31.324175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.326247 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.326689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.330226 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.330712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.331221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.501741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:31.502503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:31.514982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.523887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.523887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.523887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.523887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.524622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.552276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:31.560798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1d56eae1-e8f7-4ed5-8c63-02ac4608326d tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.255264 Aug 07 12:23:31.561380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 113/210] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:31 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:31.684997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:31.685686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:31.691813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.693063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.693684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.694395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:31.694848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:31.695301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:31.880375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:31.888718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9dd7fc06-cbf4-4357-911a-b99fe0232bb9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.211052 Aug 07 12:23:31.889476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 114/211] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:31 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:32.038472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:32.046330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c22a8730-f1ae-419f-a941-6ddaa130983c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.548420 Aug 07 12:23:32.046908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 98/212] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:31 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:32.140233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:32.140609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:32.147735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.148225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.148865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.150140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.150601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.151045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.241941 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:32.249719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-97f05749-244f-4f8a-8328-bf298f8ef95f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1204 microversion: 2.1 time: 0.114299 Aug 07 12:23:32.250294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 115/213] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:32 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1204 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:32.581708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:32.582417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:32.592909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.601390 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.601923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.607204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.607547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.608034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.909713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:32.910435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:32.913521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:32.918933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.919372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.919550 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.920427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:32.920886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:32.921145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:32.921309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:32.930675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1aa0a43b-5299-4ad6-8b96-0c9b244b09f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.352679 Aug 07 12:23:32.931510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 99/214] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:32 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:33.067423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:33.068719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:33.074012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:33.075271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.075757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.076187 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.076876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.077368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.079233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.081545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-14564565-6596-4825-9d6b-1aa3e9218b18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.175704 Aug 07 12:23:33.082348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 116/215] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:32 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:33.276195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:33.276999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:33.285818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.286765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.288289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.289661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.290391 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.291055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.509224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:33.512553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:33.518038 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9cf8ed3c-7f68-4a6b-8963-157668119773 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.454480 Aug 07 12:23:33.521557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cec03ab9-51c4-4fa4-a6c5-e1403ef4aabf tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1271 microversion: 2.1 time: 0.251715 Aug 07 12:23:33.522716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 117/216] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:33 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:33.536959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 100/217] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:33 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:33.539730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd67a2c0-dbe5-4118-b57f-dc7f73877d08", "name": "network-vif-plugged", "status": "completed", "tag": "60e58be3-95b0-4385-be72-29086cd43dc3"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:33.549293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.549753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.550219 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.563116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] Creating event network-vif-plugged:60e58be3-95b0-4385-be72-29086cd43dc3 for instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 on hv-cinder-84984 Aug 07 12:23:33.568316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-6c48808a-63e8-45f1-9698-96f3f302fdc7 req-2186855b-1e84-456f-b76b-cd2b53b101f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043962 Aug 07 12:23:33.569268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 118/218] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:33.950995 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:33.951616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:33.957563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.958583 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.959036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:33.959721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:33.960165 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:33.960580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.102787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:34.104695 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:34.111366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.112208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.112724 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.113644 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.114208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.114873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.132281 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:34.141175 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3e591cfc-0235-4c0b-b8cf-d8a8640169bc tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.193913 Aug 07 12:23:34.150474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 101/219] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:33 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:34.262284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:34.270178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-95d21074-32b8-41ce-ba0e-2bfff1eae3a4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.172134 Aug 07 12:23:34.270777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 119/220] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:34 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:34.539616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:34.540228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:34.542183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:34.545513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:34.546598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.547125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.547569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.548302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.548754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.549181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.549375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.549856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.550290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.551092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:34.553007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:34.553452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:34.696213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:34.702240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:34.703758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2e627523-0213-4388-add6-41d68a7f937b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.168432 Aug 07 12:23:34.704328 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 102/221] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:34 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:34.710938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4d4af54a-bd47-4b29-911e-2b854caf4d96 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1271 microversion: 2.1 time: 0.172739 Aug 07 12:23:34.711692 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 120/222] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:34 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:35.162019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:35.162623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:35.168569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.169042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.169471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.170153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.170601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.171036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.291918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:35.294084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:35.300135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.300630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.301069 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.301765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.303283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.303706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.352877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:35.363161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6f5e8ec0-636f-476e-8d8e-f13b38b80f43 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.202790 Aug 07 12:23:35.363161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 103/223] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:35 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:35.440354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:35.448190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-df3fe6f0-4db3-4ff1-9d35-cd1ee2a0be49 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.161601 Aug 07 12:23:35.448760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 121/224] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:35 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:35.725809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:35.726401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:35.733111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.733593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.734021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.734705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.735098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:35.735589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.735689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.735899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:35.742229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.742229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.742517 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.743232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:35.743678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:35.744095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:35.888034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:35.898687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5ccc7b08-6302-4690-8d4d-b7098286ee43 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.177523 Aug 07 12:23:35.899622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 104/225] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:35 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:36.030085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:36.037718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6b442841-77aa-4088-ae54-b91881bd4490 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1271 microversion: 2.1 time: 0.306452 Aug 07 12:23:36.038277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 122/226] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:35 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:36.381744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:36.388589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:36.388589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.389131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.389568 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:36.390309 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.390762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.391241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:36.395422 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:36.468289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:36.468902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:36.474821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.475373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.475812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:36.476508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.476965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.477467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:36.535356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:36.542789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-37d6b048-b814-4ead-b5f5-5a4da1c88362 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.164968 Aug 07 12:23:36.543603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 105/227] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:36 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:36.616208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:36.627670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d14f6fb2-fb29-4a77-81af-dce9dd5ad9b8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.163252 Aug 07 12:23:36.628433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 123/228] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:36 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:36.919280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:36.919911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:36.926630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.927127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.927560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:36.928247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:36.928695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:36.929108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.057768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:37.058904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:37.074842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.075379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.075990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.076703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.077166 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.077594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.205630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:37.215795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5dee60c0-9bd4-4cfc-83c4-daa19120076b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.300254 Aug 07 12:23:37.216382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 106/229] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:36 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:37.294800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:37.304637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7a66ec4f-433a-4b89-ad0f-285ac6e43e36 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1271 microversion: 2.1 time: 0.250621 Aug 07 12:23:37.305423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 124/230] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:37 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:37.563575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:37.565014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:37.571632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.572355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.572786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.573489 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.573942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.574366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.649372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:37.650233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:37.666912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.671892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.671892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.671892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:37.671892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:37.672610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:37.806157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:37.815512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:37.816046 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fbe1afba-d8cc-41d0-8be4-4a62f39a0aa5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.256503 Aug 07 12:23:37.817311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 107/231] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:37 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:37.823100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-347e4caa-d612-48ea-94be-8513c5af0bf8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.178355 Aug 07 12:23:37.835639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 125/232] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:37 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:38.051765 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:38.061818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.062287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.062709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.073911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] Creating event network-changed:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:23:38.078777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-7a435a2d-6543-40ad-8a30-eede7f8b91cb req-fec34097-1d05-48c2-a3ea-e6bdd4e66278 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Aug 07 12:23:38.079459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 108/233] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:38.236327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:38.236943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:38.243120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.243604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.244040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.244774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.245232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.245654 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.322688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:38.323546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=8 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:38.327577 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:38.328271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:38.334979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.335491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.335985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.336619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.337068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.337487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.381649 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:38.390365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a8d4200c-aef7-4cf6-a75f-683c25a6cfc1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.157934 Aug 07 12:23:38.393214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 126/234] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:38 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:38.483512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:38.491140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b3f2059c-7119-420b-9d4e-b68930cf13e9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.169359 Aug 07 12:23:38.491709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 109/235] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:38 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:38.847701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:38.848350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:38.852072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:38.852846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:38.868519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.869713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.870974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.875166 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.883977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.885709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.887334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.887886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.888120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:38.888868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.889254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:38.889740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:38.891499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=20 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:39.066092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:39.079035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:39.082681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b0210e45-0f11-44a7-8623-4ccb91c40fe3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.241535 Aug 07 12:23:39.082681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 110/236] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:38 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:39.087386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6b0ace87-4198-41cf-8ece-eaed31096e58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1318 microversion: 2.1 time: 0.251339 Aug 07 12:23:39.088624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 127/237] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:38 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:39.261885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a26c053-8ae7-4956-9ffa-ae344cea68e3", "name": "network-vif-plugged", "status": "completed", "tag": "6dfb8044-a614-4cd6-b9ed-d0187b469bdc"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:39.272005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:39.272465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:39.272886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:39.283690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] Creating event network-vif-plugged:6dfb8044-a614-4cd6-b9ed-d0187b469bdc for instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 on hv-cinder-84984 Aug 07 12:23:39.288855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-092a3a74-08a5-4536-b016-cb3a7443e2e7 req-8e244e9c-dd44-4fe2-9b3f-395abe2e38fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Aug 07 12:23:39.289437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 111/238] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:23:39.411451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:39.415847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:39.418625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:39.419158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:39.419602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:39.420308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:39.420765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:39.421194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:39.425439 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:39.512704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:39.513698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:39.519872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:39.520355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:39.520878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:39.521582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:39.522032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:39.522462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:39.566273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:39.574691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-434da05c-5abc-464e-bb18-5e33b83f833f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.167129 Aug 07 12:23:39.588804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 128/239] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:39 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:39.737510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:39.745801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-96904d3d-01ac-46e3-a9a0-c2969b565f7a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.237539 Aug 07 12:23:39.746372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 112/240] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:39 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:40.102763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:40.108810 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:40.110386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.111316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.111606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.112319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.112551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:40.112920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.113186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:40.113291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.132386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.132875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.133303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.133996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.134442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.134858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.293060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:40.298066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:40.300670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1fead743-a3c4-405d-a58a-e44987d1c481 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1507 microversion: 2.1 time: 0.195317 Aug 07 12:23:40.301252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 113/241] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:40 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:40.309040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a02c8434-3402-4a36-a52d-de2643ea9ab1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.209089 Aug 07 12:23:40.309040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 129/242] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:40 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:40.595800 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:40.596417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:40.602323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.604933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.604933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.604933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.604933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.605403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.745913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:40.754023 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7684b27e-d282-47c9-a79c-a39bc50f5859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.162098 Aug 07 12:23:40.758432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 114/243] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:40 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:40.778224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:40.778836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:40.784736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.785221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.785942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.786690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:40.787180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:40.787964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:40.957648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:40.967265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-08fc3f9d-3aa1-4b7b-8008-5a2cf2bd8c4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.192959 Aug 07 12:23:40.967836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 130/244] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:40 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:41.328003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:41.328641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:41.335658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:41.336135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:41.336575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:41.337258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:41.337705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:41.338121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:41.476219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:41.489693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-79bb8d19-ad56-4f29-91b0-48c05db3b934 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1366 microversion: 2.1 time: 0.161120 Aug 07 12:23:41.489693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 115/245] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:41 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:23:41.780346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:41.781099 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:41.788173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:41.788719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:41.789087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:41.789778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:41.790504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:41.790934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:41.935563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:41.943141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b2030c27-8a4f-4292-936a-141561038265 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.166652 Aug 07 12:23:41.943753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 131/246] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:41 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:41.996860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:41.999326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:42.005435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.006128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.006565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.007458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.008207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.009660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.159565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:42.167086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-295f5cac-59bb-4c4a-8c29-bce821fdaa06 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.180798 Aug 07 12:23:42.167748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 116/247] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:41 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:42.509737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:42.510266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:42.516437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.516909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.517338 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.518011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.518457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.518876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.666885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:42.674345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d92b45fa-bf08-44a0-89d5-10e9e1ffc77f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1556 microversion: 2.1 time: 0.169130 Aug 07 12:23:42.674903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 132/248] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:42 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:42.696108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:42.696747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:42.703380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.703864 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.704300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.705004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.705463 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.705889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.789204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6ad1f0ad-742f-4621-8158-af473e88d477 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098093 Aug 07 12:23:42.789795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 117/249] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:23:42 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:42.966737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:42.968156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:42.977659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.978190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.978668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:42.979398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:42.979844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:42.980471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:43.158184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:43.166858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7a6b1253-3659-4576-aa86-600fb7bde299 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.206157 Aug 07 12:23:43.169062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 133/250] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:42 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:43.188088 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:43.188685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:43.194701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:43.195445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:43.195867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:43.196773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:43.197646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:43.197646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:43.508320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:43.516250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8e0b40ad-fb89-4b70-bebb-0c7a97183146 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.332601 Aug 07 12:23:43.523433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 118/251] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:43 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:44.198371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:44.199530 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:44.207912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:44.210026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:44.210536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:44.216007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:44.216007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:44.216007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:44.393701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:44.403672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-23325a33-2511-4ad9-8a4e-70475ef6ac7e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.210304 Aug 07 12:23:44.404716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 134/252] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:44 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:44.423786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a26c053-8ae7-4956-9ffa-ae344cea68e3", "tag": "6dfb8044-a614-4cd6-b9ed-d0187b469bdc"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:44.438411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:44.438892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:44.439362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:44.452500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] Creating event network-changed:6dfb8044-a614-4cd6-b9ed-d0187b469bdc for instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 on hv-cinder-84984 Aug 07 12:23:44.458061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-f2af7b4d-0cd5-4404-8fb5-e662ca95f529 req-f7e7a7d8-0c25-4793-8998-01c1c235f918 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038049 Aug 07 12:23:44.459675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 119/253] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:23:44.541945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:44.542966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:44.551880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:44.553215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:44.553921 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:44.555079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:44.557434 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:44.558149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:44.734465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:44.749436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-28169a96-254a-462c-8ed2-6ae9a2ecd720 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.214538 Aug 07 12:23:44.752694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 135/254] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:44 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:45.427809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:45.428606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:45.435394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:45.435980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:45.437135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:45.438046 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:45.438509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:45.438938 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:45.611563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:45.621019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cbd42f6c-41a1-4181-b011-c8e3b396dd6e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.198145 Aug 07 12:23:45.622133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 120/255] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:45 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:45.782449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:45.784136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:45.792231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:45.792742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:45.793179 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:45.794461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:45.794971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:45.795463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:46.050442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:46.060495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f62e65da-990c-4a61-a7c3-fd27a33f19ba tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.287646 Aug 07 12:23:46.061183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 136/256] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:45 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:46.648093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:46.652117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:46.655683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:46.656176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:46.656618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:46.657383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:46.657840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:46.658267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:46.869289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:46.878512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cc9aa4e5-d3b9-45a4-b882-def3a0725019 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.235264 Aug 07 12:23:46.879167 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 121/257] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:46 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:47.082832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:47.084633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:47.091682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.092764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.093430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:47.095047 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.095703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.096338 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:47.264913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:47.272988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f632059c-cc00-4e53-b3b8-7777e5ee1685 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.194471 Aug 07 12:23:47.273577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 137/258] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:47 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:47.563851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:47.564342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:47.571768 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.572249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.572684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:47.573376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.573814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.574229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:47.597903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d145bd7c-8c3c-4fa4-8cb3-214f71067231 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/ips" status: 200 len: 152 microversion: 2.20 time: 0.037916 Aug 07 12:23:47.598506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 122/259] 10.222.0.30 () {60 vars in 1289 bytes} [Sun Aug 7 12:23:47 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:23:47.915347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:47.915347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:47.916127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.916696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.917186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:47.917967 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:47.918485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:47.918984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:48.076656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:48.084813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fa42cf9b-b93f-462c-b389-53b4a182e89b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.187118 Aug 07 12:23:48.092121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 138/260] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:47 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:48.294248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:48.294879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:48.301447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:48.302196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:48.302630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:48.303379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:48.303841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:48.304268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:48.437781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:48.445788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a0d569c5-3a5c-4363-8161-91de55e36c18 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.155581 Aug 07 12:23:48.446357 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 123/261] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:48 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:49.106928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:49.107635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:49.113716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:49.114231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:49.115669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:49.116368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:49.116815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:49.117240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:49.249987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:49.258119 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f52b0a31-6498-4ea7-b8db-05ee34820cd5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.155016 Aug 07 12:23:49.258686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 139/262] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:49 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:49.466382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:23:49.466930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:49.473225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:49.473771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:49.474197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:49.474878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:49.475359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:49.475778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:49.494158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:23:49.614458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:23:49.622758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8f9534e5-1eb2-4b50-a574-0f076ce0eac2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.160449 Aug 07 12:23:49.623436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 124/263] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:23:49 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:23:50.163808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1344782752", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "networks": [{"uuid": "87afe721-ec24-4d63-9fd8-b38ac630c7e8"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:50.189600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:23:50.190174 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:23:50.196898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:50.197400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:50.197883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:50.198788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:23:50.199273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:23:50.199716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:23:50.223279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lazy-loading 'flavor' on Instance uuid 4c38525f-a106-4669-87ad-fd3e321a65d7 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:23:59.254463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=70 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:00.175292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=75 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:00.199503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=61 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:00.218377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] validate_networks() for [('87afe721-ec24-4d63-9fd8-b38ac630c7e8', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:24:00.444081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9b7b51f1-1dbc-4da6-9a3d-2b3924e4c923 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/action" status: 202 len: 0 microversion: 2.20 time: 10.258405 Aug 07 12:24:00.447644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 125/264] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 12:23:50 2022] POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/action => generated 0 bytes in 10260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:24:00.449539 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:00.450229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:00.456645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.457124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.457551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.458437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.458929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.460396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.601688 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:24:00.602161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:24:00.602602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:24:00.603024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:24:00.603513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:24:00.612659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.613151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.613619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.614361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.615108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.615571 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.620887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.628555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-36aa84af-1dfc-4e0d-bb3f-8d306df4c56b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.182868 Aug 07 12:24:00.629131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 126/265] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:00 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:00.634120 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:00.634464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:00.634825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Getting quotas for project 74e6b27298e34383acb124fd4fc56918. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:00.639858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Getting quotas for user 522765afd64c4018baebae36facfc3f3 and project 74e6b27298e34383acb124fd4fc56918. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:00.640479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.641004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.641444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.642145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.642518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.642937 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.651846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:24:00.654197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:24:00.777984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.785452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-813af55e-bc00-4dad-aae5-42bad18e4c61 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.155387 Aug 07 12:24:00.786023 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 127/266] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:00 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:00.791264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "name": "network-vif-plugged", "status": "completed", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:00.800905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.810670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.810800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-95b922f8-9e08-4b24-aba0-5e5e07484fe7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.643052 Aug 07 12:24:00.810885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.810977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 140/267] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:23:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 10644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:24:00.810977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:00.810977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:00.813770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.814422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.814603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] Creating event network-vif-plugged:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:24:00.815216 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.816555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:00.817057 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:00.817502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:00.819967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-51a10b91-cc61-4b18-8e10-26b82060b26f req-317edf08-707c-44c4-8c74-d01e82e4790a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 Aug 07 12:24:00.820733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 128/268] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:00.826760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-43534c73-3fca-4d00-8c0f-3099f3004521 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:00.827605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-43534c73-3fca-4d00-8c0f-3099f3004521 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:00.889960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43534c73-3fca-4d00-8c0f-3099f3004521 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.903927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-43534c73-3fca-4d00-8c0f-3099f3004521 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1214 microversion: 2.1 time: 0.076486 Aug 07 12:24:00.903927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 129/269] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:00 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:00.980096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.988350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.990034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:00.991732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-815a07dc-049c-4256-8839-550b72ce9b00 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.188645 Aug 07 12:24:00.992661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 141/270] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:00 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:01.648769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:01.649380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:01.656461 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.656945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.657376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.658127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.658580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.659014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.798783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:01.806756 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:01.807553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:01.807656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0302f58b-9cc7-49b2-b0f0-433672565959 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.162766 Aug 07 12:24:01.808130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 130/271] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:01 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:01.814229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.814765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.815274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.815970 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.816426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.816882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.919813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:01.920585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:01.927300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.927789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.928887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.929870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:01.930328 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:01.930888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:01.952012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:01.959824 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f516c940-8ea0-40ab-9e1a-a10c82646a1c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.157460 Aug 07 12:24:01.960370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 142/272] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:01 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:01.996082 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:02.003754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-84216f4b-497e-4de5-a209-2803d4644c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1218 microversion: 2.1 time: 0.088242 Aug 07 12:24:02.004318 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 131/273] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:01 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:02.015585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:02.016216 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:02.023078 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.023574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.024015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:02.024718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.025174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.025603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:02.177397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:02.184889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:02.186445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:02.187716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6825dc8d-76a5-40d1-b5ca-248e48975128 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.176466 Aug 07 12:24:02.188283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 143/274] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:02 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:02.829687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:02.830523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:02.837226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.837714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.838152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:02.838984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.839535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.839968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:02.972215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:02.979828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-432dc87e-a96c-4a90-86de-3f7e85d08b53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.154838 Aug 07 12:24:02.980408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 132/275] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:02 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:02.980537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:02.981129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:02.987303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.998761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.998761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:02.998761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:02.998761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:02.999172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:03.023662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:03.024376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:03.030470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:03.030947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:03.031447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:03.032146 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:03.032592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:03.033013 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:03.098950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:03.107346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-98937007-c697-483c-9d82-92689aba9eef tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1266 microversion: 2.1 time: 0.087701 Aug 07 12:24:03.108027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 133/276] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:03 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:03.126201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:03.134616 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3dca60f8-fd0b-4a9a-863d-d1483aa726a4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.158063 Aug 07 12:24:03.135215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 144/277] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:02 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:03.213161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:03.213777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:03.219646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:03.220131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:03.220565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:03.221253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:03.221733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:03.222160 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:03.353522 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:03.361496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:03.363052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:03.364222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-94cd26f5-ca23-47f8-aacf-4ed80287c43a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.155893 Aug 07 12:24:03.364779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 134/278] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:03 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:04.000385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:04.001483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:04.007768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.008293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.008715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.009398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.009846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.010264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.133396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:04.135952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:04.148485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.152633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.152633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.152633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.152633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.152998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.161161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.170398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-641d8909-5362-4293-935a-9851665ede50 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.173856 Aug 07 12:24:04.171282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 145/279] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:03 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:04.191834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:04.192634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:04.198890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.199429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.200213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.201868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.202742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.203409 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.236754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.244443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3931ec52-fc31-4ca7-bc9d-f09162c19b94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1266 microversion: 2.1 time: 0.118747 Aug 07 12:24:04.245024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 135/280] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:04 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:04.343420 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.351589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3eb7a5a9-97ac-479c-b7fa-06edf4106dd4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.163435 Aug 07 12:24:04.352240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 146/281] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:04 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:04.388367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:04.388974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:04.395047 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.395726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.396162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.396888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:04.397338 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:04.397759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:04.559632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.567637 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.569136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:04.570333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-531ef310-cf8e-4d01-b948-15a26849955b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.186201 Aug 07 12:24:04.570898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 136/282] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:04 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:05.194635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:05.195754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.201834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.202321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.202755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.203645 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.204146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.204573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.265331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:05.266192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.271948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.272431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.272858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.274192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.274647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.275209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.340592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.350272 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b57ecc42-5031-4635-8f46-63bd98f024c2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1266 microversion: 2.1 time: 0.089106 Aug 07 12:24:05.355130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 137/283] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:05 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:05.358303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.370854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2b4a788a-930e-4940-8dc1-2e4c6c4ad5a0 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1500 microversion: 2.1 time: 0.179911 Aug 07 12:24:05.371454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 147/284] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:05 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1500 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:05.374163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:05.374772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.381074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.381548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.381969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.382967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.383443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.383857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.391710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a11de04-d43d-42b4-bc95-7be359d02278"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:05.398427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.400935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.401431 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.401872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.402574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.403291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.403721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.428432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] HTTP exception thrown: Cannot 'attach_volume' instance 612dc648-62d5-4d0b-9f0a-c5c092085095 while it is in vm_state rescued Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Request method failure captured: Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/os-volume_attachments HTTP/1.1 Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 74 Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765lTiZk3RyAxPFqNVeA7LvzADGnZ-Ru0dBpLB3VVpSGqb47_eCoqOp6eL78s9D_vcfNvmC5mALSLE_R-jcQoq89ns2TjgJd9oLJZ5kO-YG2lFRgBVqindnPWSVHFAmqP9olb_mr1R91bJxTM8nK7XVLCfKJ3Hx5xMSsnuz8R7o6kWM Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:24:05.431421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd31c40f797549d082e083324e285b6e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd31c40f797549d082e083324e285b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 90dc7b751dd14c6f80205e709826423b Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {"volumeAttachment": {"volumeId": "3a11de04-d43d-42b4-bc95-7be359d02278"}} Aug 07 12:24:05.432804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Cannot 'attach_volume' instance 612dc648-62d5-4d0b-9f0a-c5c092085095 while it is in vm_state rescued Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'server_id': '612dc648-62d5-4d0b-9f0a-c5c092085095', 'body': {'volumeAttachment': {'volumeId': '3a11de04-d43d-42b4-bc95-7be359d02278'}}} Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:24:05.433551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 612dc648-62d5-4d0b-9f0a-c5c092085095 while it is in vm_state rescued Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:05.435520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 612dc648-62d5-4d0b-9f0a-c5c092085095 while it is in vm_state rescued Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Returning 409 to user: Cannot 'attach_volume' instance 612dc648-62d5-4d0b-9f0a-c5c092085095 while it is in vm_state rescued {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:24:05.437121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ef6baff6-c943-4f2d-8363-02a2d51ea513 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045363 Aug 07 12:24:05.437659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 148/285] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:24:05 2022] POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 07 12:24:05.442120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:05.442584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.449280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.449767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.450201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.451045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.451502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.451952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.538452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.546963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a306a68e-e89f-40d2-b255-1005449f93b9 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1259 microversion: 2.1 time: 0.177774 Aug 07 12:24:05.547560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 138/286] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:05 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:05.593261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:05.594104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.602218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.602678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.603148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.603840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.604454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.604876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.667432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2960bf22-7e1e-42ab-80a4-a7b91246e128 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/action" status: 202 len: 0 microversion: 2.1 time: 0.228800 Aug 07 12:24:05.668064 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 149/287] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:24:05 2022] POST /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:24:05.676466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:05.677195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:05.683961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.684418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.684861 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.685554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:05.686018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:05.686496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:05.742274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.751551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.753685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.754345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3a887cde-4f90-427e-88f9-c5158cbe1044 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.165106 Aug 07 12:24:05.755236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 139/288] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:05 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:24:05.851880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:05.861257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8502ee42-4bcb-4af8-9b5c-9905ad0f1ea1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.188854 Aug 07 12:24:05.861831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 150/289] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:05 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:06.371511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:06.372790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:06.379156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.380008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.385610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.385610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.385610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.385610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.480602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:06.484321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:06.489150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d0e457b0-9a30-4eaf-b869-d4c3af849dd3 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1274 microversion: 2.1 time: 0.121870 Aug 07 12:24:06.490270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 140/290] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:06 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:06.567691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:06.568392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:06.574871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.575470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.575978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.576681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.577215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.577653 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.731479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:06.740016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f6becea0-df38-45f8-882f-4f20ddf7a494 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1444 microversion: 2.1 time: 0.176351 Aug 07 12:24:06.740611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 151/291] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:06 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:06.761001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:06.761613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:06.768835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.769318 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.769759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.770475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.772370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.772370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.779118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:06.780024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:06.786414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.787044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.787556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.788502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.789974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.790740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.949727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:06.960058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:06.962200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:06.964593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e0c0f001-826e-43bf-9c8c-eb5526cab3f9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.190136 Aug 07 12:24:06.965275 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 152/292] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:06 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:06.970748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:06.971835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:06.979883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.981650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.981650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:06.982660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:06.983227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:06.983734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:07.130552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:07.140532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7e37380f-8f34-456a-a987-6ece8912e185 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.173826 Aug 07 12:24:07.142175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 153/293] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:06 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:07.353556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:07.361156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-021f5adb-f246-45e9-9749-789e1a0f6213 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1444 microversion: 2.1 time: 0.604063 Aug 07 12:24:07.361736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 141/294] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:06 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1444 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:07.512699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:07.513892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:07.520993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:07.522317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:07.523463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:07.525389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:07.526080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:07.526831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:07.608495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:07.631667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-967c2dbb-e0ee-4d66-a46c-2d1f5fb5b553 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1272 microversion: 2.1 time: 0.125182 Aug 07 12:24:07.632250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 154/295] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:07 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:07.989839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:07.991103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:07.998291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:07.999018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:07.999631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.000691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.001200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.001627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.165253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:08.166097 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:08.174196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.174957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.179882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.179882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.179882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.179882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.283063 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:08.292993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:08.294516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:08.299673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-90c496d2-e465-49fd-ae6f-9f42276f700c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.313679 Aug 07 12:24:08.310340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 142/296] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:07 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:08.449557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:08.456930 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-409251f1-bf3f-4c0c-b60d-54269513c597 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.296956 Aug 07 12:24:08.457496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 155/297] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:08 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:08.654931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:08.655717 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:08.665282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.666633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.667361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.671105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.672911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.673621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.851717 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:08.858939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-074756ee-e053-407a-8de6-cedd16277e79 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.208518 Aug 07 12:24:08.859541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 143/298] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:08 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:08.917227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e698b8b9-c5b5-4a28-b65e-ac793eea2d0f", "tag": "9261c337-60fb-4fdd-a657-eb7ddc444719"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:08.945506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:08.948265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:08.949727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:08.977964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] Creating event network-changed:9261c337-60fb-4fdd-a657-eb7ddc444719 for instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f on hv-cinder-84984 Aug 07 12:24:08.986324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-3a54768d-a8af-4672-882e-ffcb35b3c66d req-40cd81b1-356b-469e-b56f-1e50f2798f91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072979 Aug 07 12:24:08.987095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 156/299] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:09.327071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:09.327676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:09.333960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.334436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.334867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:09.335751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.336255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.336681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:09.469525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:09.477983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:09.479421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:09.479926 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:09.480418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:09.495124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b6774dce-a2b8-4c5f-98f8-020a094f9c5c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.158322 Aug 07 12:24:09.495124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 144/300] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:09 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:24:09.495589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.495589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.495589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:09.495589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.495924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.495924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:09.505311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:09.721207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:09.729094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f60d6dcc-245b-44b1-b801-b490eeabf5a3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.254893 Aug 07 12:24:09.729627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 157/301] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:09 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:09.889252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:09.889868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:09.896027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.896517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.896959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:09.897654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:09.898389 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:09.899130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.042987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:10.054936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:10.057041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:10.057783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:10.059424 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.063664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d104db5f-9a3f-411a-8fdc-dece0e67eb40 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.178724 Aug 07 12:24:10.065293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 145/302] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:09 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:10.076089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] Creating event network-changed:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:24:10.082438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-8da5db51-0cea-41c1-b479-587fbd8099d9 req-75919f5c-0925-423e-b098-46e750062370 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044220 Aug 07 12:24:10.083096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 158/303] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:10.506133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:10.506671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:10.513795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:10.514277 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:10.514727 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.515436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:10.515891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:10.516312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.686410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:10.696207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:10.697746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:10.699098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-52d3f541-5c97-46c9-b57d-7b319f939feb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.196983 Aug 07 12:24:10.707040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 146/304] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:10 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:10.747189 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:10.750730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=6 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:10.752095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:10.752792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:10.759465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:10.759890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:10.760331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.761013 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:10.761466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:10.761893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:10.932879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:10.940544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6e8d5234-7507-490b-8ca7-7fc608916fae tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.194459 Aug 07 12:24:10.947223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 159/305] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:10 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:11.090516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:11.090516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:11.093967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:11.095452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.096816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.098204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:11.099226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.099901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.100523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:11.251511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:11.259319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dc8f0d8a-ce89-4601-8856-72a212783023 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.175102 Aug 07 12:24:11.263164 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 147/306] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:11 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:11.723248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:11.723796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:11.730294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.730810 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.731274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:11.731998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.732453 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.732897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:11.864775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:11.873760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:11.875306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:11.876470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fca1a2dc-f02c-42d8-aecf-a59cb5c19a89 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.157282 Aug 07 12:24:11.877331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 160/307] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:11 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:11.966402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:11.967032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:11.973459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.973941 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.974374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:11.975095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:11.975579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:11.976021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:12.106735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:12.114324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-31ccfa7f-d570-4703-8d17-8ec2960a73e7 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.152428 Aug 07 12:24:12.114885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 148/308] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:11 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:12.281096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:12.281710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:12.287912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:12.288399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:12.288833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:12.289545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:12.290013 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:12.290612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:12.420164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:12.427470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-11353909-a2ae-4188-aca4-9f6076c56cd1 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.150248 Aug 07 12:24:12.428346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 161/309] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:12 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:12.900063 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:12.900561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:12.907224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:12.907707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:12.908139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:12.908826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:12.909276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:12.909695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.128043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:13.136221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:13.136945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:13.137993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:13.139982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:13.140899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9205702b-0bc2-4613-878c-91b2e1cae629 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.244950 Aug 07 12:24:13.142029 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 149/310] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:12 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:13.144836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.145512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.145973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.146890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.147436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.148072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.242642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce0fa32e-786b-4f53-9b58-9e170b58a409", "device": "/dev/sdb"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:13.246098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:13.256378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.257376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.257818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.258511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.258964 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.259402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.301497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:13.309445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c7405e1b-d760-494c-8f25-76b8a652d055 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1508 microversion: 2.1 time: 0.178790 Aug 07 12:24:13.310020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 162/311] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:13 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:13.448821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:13.449472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:13.455326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.455819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.456258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.456953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:13.457408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:13.457835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:13.587152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:13.595262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d003e7ac-d1d0-4a0f-b55c-112ec508b29f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.150501 Aug 07 12:24:13.595825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 163/312] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:13 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:14.166025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:14.169331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:14.175552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.176033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.176629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.177771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.178221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.179307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.321946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:14.332949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:14.334925 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:14.336062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e419d923-d3b3-4490-b6fb-efdfb3fa0dbc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.174410 Aug 07 12:24:14.336807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 164/313] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:14 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:14.344753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:14.345563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:14.354722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.356016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.356682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.357393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.358002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.358808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.509299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:14.517819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-52f33ca7-d234-4009-bbd2-6950b49f8d0f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1514 microversion: 2.1 time: 0.179537 Aug 07 12:24:14.518671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 165/314] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:14 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:14.610496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-244f9145-8e97-42f0-8818-016fb0ba4a86 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "POST /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.371583 Aug 07 12:24:14.611145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 150/315] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:24:13 2022] POST /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08/os-volume_attachments => generated 194 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:14.616132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:14.616872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:14.623762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.624255 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.624690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.625392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:14.625846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:14.626278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:14.806792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:14.815206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2090b19c-bbdb-4df5-9aa9-143b5fcfeb94 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.203416 Aug 07 12:24:14.815862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 166/316] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:14 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:15.362171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:15.362876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:15.370669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:15.371105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:15.371545 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:15.372245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:15.372789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:15.373107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:15.504636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:15.513788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:15.515563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:15.516727 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-02dccea3-8949-4194-9e41-ee1cb1c54199 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.159127 Aug 07 12:24:15.517281 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 151/317] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:15 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:15.836430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:15.836964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:15.843722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:15.844200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:15.844631 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:15.848103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:15.848103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:15.848103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:15.979435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:15.986934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-56f2f770-a8f3-4919-885c-b0737bcd1ab9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.154398 Aug 07 12:24:15.987842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 167/318] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:15 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:16.539816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:16.540476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:16.547017 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:16.547508 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:16.547944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:16.548633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:16.549088 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:16.549510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:16.704845 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:16.704845 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:16.707258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:16.707258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c3dbdc69-9d3b-46c4-a425-a5ca525a5db3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.160843 Aug 07 12:24:16.707258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 152/319] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:16 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:24:17.007308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:17.007953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:17.015476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:17.016010 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:17.016421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:17.017111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:17.017565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:17.017987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:17.146712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:17.154292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-38ff46bf-622b-4365-9466-b5401f91ecfc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.150892 Aug 07 12:24:17.154859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 168/320] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:17 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:17.462634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ff110c08-a674-4f1e-9c74-bf5fb486be22 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: .version_select at 0x7f77a40a0700>, body: {"keypair": {"name": "tempest-keypair-1116993921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQNicwlv6fD1kkdl8hKqterNs1MRrG70AeVTNdevRgtVgQQ3YH6OArZpvIdwYr9a94MjFFpmPUGb/O4Ek2MVL1GL/Jy1vZXaEWJHuE9Pe3IVsbBuJjI5AT1Vg3tvXff9w=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:17.498132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-ff110c08-a674-4f1e-9c74-bf5fb486be22 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for project bd31c40f797549d082e083324e285b6e. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:17.502129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-ff110c08-a674-4f1e-9c74-bf5fb486be22 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for user 90dc7b751dd14c6f80205e709826423b and project bd31c40f797549d082e083324e285b6e. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:17.623221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ff110c08-a674-4f1e-9c74-bf5fb486be22 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164328 Aug 07 12:24:17.624057 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 153/321] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:24:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:17.724978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:17.725696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:17.732794 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:17.733880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:17.734332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:17.735142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:17.735610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:17.736025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:17.895990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:17.911278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:17.916689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:17.916689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5bfaad4b-01a1-4e4c-b4a0-4f47fc482a9c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.194855 Aug 07 12:24:17.923149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 169/322] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:17 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:18.173841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:18.174458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:18.180388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:18.180860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:18.181285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:18.181966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:18.182410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:18.183012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:18.334573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:18.351761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4d88bdb7-79a7-433e-9eb1-05246ecbbe7c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.175076 Aug 07 12:24:18.351761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 154/323] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:18 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:18.945055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:18.945677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:18.953136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:18.954795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:18.954795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:18.954795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:18.955315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:18.955746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:19.186810 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:19.195457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:19.197311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:19.199583 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e9c0a58c-5a7d-4bfd-a4d9-c787d2cb644b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1744 microversion: 2.20 time: 0.258065 Aug 07 12:24:19.200765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 170/324] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:18 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:19.377757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:19.378956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:19.400562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:19.401231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:19.402385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:19.403502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:19.406961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:19.407643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:19.632245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:19.646311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6dfc1f54-a053-442a-a8fd-83680e322a77 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.272103 Aug 07 12:24:19.648923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 155/325] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:19 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:19.663815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698b8b9-c5b5-4a28-b65e-ac793eea2d0f", "name": "network-vif-plugged", "status": "completed", "tag": "9261c337-60fb-4fdd-a657-eb7ddc444719"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:19.681549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:19.682234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:19.682826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:19.694850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] Creating event network-vif-plugged:9261c337-60fb-4fdd-a657-eb7ddc444719 for instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f on hv-cinder-84984 Aug 07 12:24:19.700735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-02f6acf7-a9c3-413c-b939-51976eccf3f9 req-e8ba4678-55d2-4238-b7e7-bf47837be45d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040294 Aug 07 12:24:19.701348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 171/326] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:20.225625 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:20.226233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:20.232978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:20.233733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:20.234335 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:20.235417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:20.236053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:20.236632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:20.561353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:20.578875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:20.583048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:20.584370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-52fcbcfb-a9f9-4d64-96b9-0bfe7eee7896 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1744 microversion: 2.20 time: 0.362665 Aug 07 12:24:20.585033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 156/327] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:20 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1744 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:20.670623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:20.671355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:20.679539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:20.680381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:20.680823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:20.693461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:20.693461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:20.693461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:20.718153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1351670119", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cb5f4a8-dc46-4932-b484-34ac93e03978"}], "security_groups": [{"name": "tempest-securitygroup--213794044"}], "key_name": "tempest-keypair-1116993921", "user_data": "}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:20.872847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] validate_networks() for [('8cb5f4a8-dc46-4932-b484-34ac93e03978', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:24:20.917642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:20.928181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-951b17b4-7d0b-4944-a6ec-0bc3577a1990 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.261484 Aug 07 12:24:20.928877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 172/328] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:20 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:21.329604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:24:21.330035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:24:21.330510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:24:21.330922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:24:21.331369 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:24:21.341497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.342196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.342798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:21.343789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.344401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.345011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:21.352554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:21.394586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:21.396485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Getting quotas for user 90dc7b751dd14c6f80205e709826423b and project bd31c40f797549d082e083324e285b6e. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:21.411885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:24:21.414549 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:24:21.570397 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e9604ee2-1ca4-40bc-8de5-ffe2b1e19981 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.857063 Aug 07 12:24:21.580097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 157/329] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:24:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:24:21.585930 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b9119b00-ba3f-44ce-9951-7507cdd7842e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:21.586783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b9119b00-ba3f-44ce-9951-7507cdd7842e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:21.615640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:21.616247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:21.623970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.624460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.624894 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:21.625656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.626103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.626573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:21.691613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b9119b00-ba3f-44ce-9951-7507cdd7842e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:21.699497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b9119b00-ba3f-44ce-9951-7507cdd7842e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1246 microversion: 2.1 time: 0.117348 Aug 07 12:24:21.700102 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 173/330] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:21 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1246 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:21.841001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:21.864033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:21.866078 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:21.867652 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0bada6c3-4bac-4383-bf1f-09d9e52213a0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1744 microversion: 2.20 time: 0.257500 Aug 07 12:24:21.868774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 158/331] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:21 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:21.951815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:21.952885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:21.959626 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.960420 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.961080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:21.962184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:21.962716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:21.963414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:22.465371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:22.474268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a71e9174-d482-4017-bf72-8899ffa170b8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1314 microversion: 2.1 time: 0.526199 Aug 07 12:24:22.476551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 174/332] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:21 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:22.722086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:22.722926 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:22.749698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:22.750542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:22.751265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:22.752166 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:22.752822 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:22.753425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:22.826936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:22.835288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cc25b129-a350-44ee-b48d-d44f2ad13d7f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1250 microversion: 2.1 time: 0.118737 Aug 07 12:24:22.836234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 159/333] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:22 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1250 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:22.892926 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:22.893534 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:22.900401 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:22.900942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:22.901595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:22.902496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:22.903143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:22.903579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.127906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:23.137659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:23.139474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:23.140666 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cdc85117-86af-4122-a025-29c5bb349bc1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.251654 Aug 07 12:24:23.141221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 175/334] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:22 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:23.496157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:23.497002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:23.505415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:23.506163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:23.506788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.507678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:23.508301 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:23.508853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.741903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:23.753838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a8e12dc2-2910-4ffa-9e0f-8e62516a145f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1497 microversion: 2.1 time: 0.261874 Aug 07 12:24:23.754515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 160/335] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:23 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:23.858039 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:23.859161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:23.872483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:23.872483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:23.872483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.872483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:23.872984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:23.876562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "name": "network-vif-plugged", "status": "completed", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:23.881918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.886958 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:23.892846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:23.900954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:23.901691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:23.902807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:23.935562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] Creating event network-vif-plugged:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:24:23.943892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-90ccc729-ac43-4b74-882c-acf7ca9f57c9 req-009524d6-73ca-4041-99aa-c67f34b34616 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073773 Aug 07 12:24:23.946616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 161/336] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:23.992965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:24.004397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-db90c278-0278-4513-b045-97dacfb76330 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1242 microversion: 2.1 time: 0.151153 Aug 07 12:24:24.019077 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 176/337] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:23 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:24.168180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:24.169742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:24.177928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:24.179104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:24.179927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:24.181086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:24.181800 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:24.182374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:24.427292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:24.438486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:24.440070 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:24.441777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f249b7f9-1f33-4fe7-a11b-0d1110fa1d12 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.278902 Aug 07 12:24:24.442503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 162/338] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:24 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:25.033740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:25.034357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:25.046289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.047787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.050889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.054279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.057809 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.061853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.133036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:25.133612 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:25.146294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.146808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.150779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.151618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.152240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.156256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.221754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:24:25.277484 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:25.289724 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-edf7cdc2-4a0b-431b-9d2d-799ff85f7a3e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1298 microversion: 2.1 time: 0.259752 Aug 07 12:24:25.290784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 177/339] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:25 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:25.469056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:25.471471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:25.500664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.501275 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.501726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.503303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.504079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.504945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.803296 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fc8a48bd-64ec-4a3e-8ecc-017f1d7680f5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 204 len: 0 microversion: 2.1 time: 0.667621 Aug 07 12:24:25.804000 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 163/340] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:24:25 2022] DELETE /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:24:25.826200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:25.829675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:25.856990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.858050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.859471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.862734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:25.864155 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:25.870112 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:25.879440 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:25.891163 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:25.894659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:25.896909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b27f7348-49c7-4b99-9eab-3cef8d4066ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.434824 Aug 07 12:24:25.898052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 178/341] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:25 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:26.132665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:26.149036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9d5ea8a2-df90-4f1e-a30b-ecede293bacc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1503 microversion: 2.1 time: 0.339552 Aug 07 12:24:26.151323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 164/342] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:25 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:26.309672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:26.310897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:26.320666 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:26.321188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:26.321574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:26.322283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:26.322733 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:26.323183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:26.412906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:26.423490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-33045e7c-fbb3-4c85-939d-6f9fb164ab65 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1316 microversion: 2.1 time: 0.116773 Aug 07 12:24:26.487201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 179/343] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:26 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:26.924034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:26.924912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:26.931801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:26.932494 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:26.934012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:26.934934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:26.935579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:26.935998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:27.172890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:27.173983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:27.178000 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:27.186982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:27.189992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:27.189992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:27.190229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:27.190716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:27.191194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:27.195042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:27.203459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:27.205195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fdb2aaa4-f7e8-4c87-9775-7051e005e2d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.285039 Aug 07 12:24:27.206403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 165/344] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:26 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:27.416623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:27.427950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a166bfa5-17bd-42a1-9ebe-87d86ca8a7d0 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1503 microversion: 2.1 time: 0.260026 Aug 07 12:24:27.429946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 180/345] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:27 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:27.456961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:27.457573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:27.470472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:27.475058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:27.475058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:27.475058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:27.475058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:27.475457 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:27.596585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:27.606739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0c7abc8a-b7e6-4e1b-a794-78abf22a4f0e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1316 microversion: 2.1 time: 0.160157 Aug 07 12:24:27.621882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 166/346] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:27 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:28.238951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:28.241721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:28.260922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.262579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.264153 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.266276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.270404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.270948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.451393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:28.452834 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:28.464402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.468521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.469215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.470265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.472178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.474008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.498579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:28.506723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:28.514167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:28.520316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-65a797b8-47e1-4cd6-940b-7ecd68cffc4b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.290811 Aug 07 12:24:28.522006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 181/347] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:28 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:28.630223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:28.630903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:28.636953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:28.639262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.639943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.640617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.641656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:28.642255 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:28.642826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:28.754609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:28.777902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d892c399-aa52-4356-9bda-a9dde71ad5a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1316 microversion: 2.1 time: 0.153599 Aug 07 12:24:28.791033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 182/348] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:28 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:28.929531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:28.955927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-44c092b6-c85a-4024-bbd5-5f3e80929424 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1503 microversion: 2.1 time: 0.509663 Aug 07 12:24:28.969959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 167/349] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:28 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1503 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:29.567414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:29.567414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:29.581098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:29.581953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:29.582396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:29.583129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:29.583584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:29.584011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:29.802217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:29.802825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:29.813511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:29.819460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:29.819460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:29.819460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:29.819460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:29.819961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:29.910210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:29.923106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:29.925097 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:29.926797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-74636216-434e-45e5-966a-7387ba642411 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.377975 Aug 07 12:24:29.950263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 183/350] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:29 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:29.978115 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:29.979174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:29.992170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:29.997067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:29.997380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:30.001624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:30.001624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:30.001936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:30.278064 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:30.289749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-38bca5c4-d06f-43e7-88ce-880e8505981c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1503 microversion: 2.1 time: 0.313868 Aug 07 12:24:30.292341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 184/351] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:29 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:30.300912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:30.311399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f840a104-4f8f-4dd3-a9b5-afdf5c4a618e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1304 microversion: 2.1 time: 0.512433 Aug 07 12:24:30.323025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 168/352] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:29 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1304 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:30.954872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:30.956381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:30.963422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:30.964195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:30.965211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:30.966330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:30.966992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:30.967594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:31.202349 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:31.212321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:31.216397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:31.220939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-84a3bb25-a6ea-45c2-9e2d-80f4dd8df9da tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.273295 Aug 07 12:24:31.221699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 185/353] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:30 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:31.321901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:31.325076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:31.334491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:31.336025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:31.336460 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:31.336850 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:31.337588 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:31.337713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:31.341637 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:31.342148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:31.350359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:31.351270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:31.352001 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:31.353036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:31.353717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:31.355585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:31.367036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:31.410370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=10 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:31.470954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:31.480259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f182319c-12b8-4dc6-827b-9b8f8ef14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1304 microversion: 2.1 time: 0.146689 Aug 07 12:24:31.484380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 186/354] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:31 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:32.053316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:32.061733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e5abb0be-20d7-47f7-85e7-b77a89a71c09 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1503 microversion: 2.1 time: 0.753602 Aug 07 12:24:32.069959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 169/355] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:31 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1503 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:32.172211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e698b8b9-c5b5-4a28-b65e-ac793eea2d0f", "name": "network-vif-deleted", "tag": "9261c337-60fb-4fdd-a657-eb7ddc444719"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:32.188125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:32.194341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:32.195547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:32.196216 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:32.225478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] Creating event network-vif-deleted:9261c337-60fb-4fdd-a657-eb7ddc444719 for instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f on hv-cinder-84984 Aug 07 12:24:32.233344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-0a4eb403-aadd-41dd-9ae9-9278006aebc7 req-8eb1fcf7-c2bf-4503-a431-0a42e532f933 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068813 Aug 07 12:24:32.236754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 187/356] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:32.244610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:32.245191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:32.256431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:32.257114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:32.257700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:32.259220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:32.259828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:32.260446 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:32.505170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:32.506851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:32.516041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:32.516862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:32.517543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:32.518508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:32.519213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:32.519855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:32.557508 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:32.577134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:32.578569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:32.591857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-70b52720-b17d-4d3f-93e7-7aab5202ff65 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.350910 Aug 07 12:24:32.605092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 170/357] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:32 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:32.701521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:32.715797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-eff42407-76a3-4505-96e4-9f7603874830 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.214964 Aug 07 12:24:32.716880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 188/358] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:32 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:33.092175 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:33.093245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:33.100679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.101671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.102352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.104011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.105211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.105922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.183526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:33.192291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7ddcf022-f545-461c-9bc1-834190cf4f3d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1461 microversion: 2.1 time: 0.104564 Aug 07 12:24:33.193646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 171/359] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:33 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1461 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:33.617967 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:33.618573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:33.630799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.632253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.632798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.634176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.634830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.638973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.745307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:33.747339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:33.765557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.773322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.773322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.773322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:33.773322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:33.773766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:33.987045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:33.998971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:34.000974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:34.002461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f4f1e12c-ebb5-400a-8335-4c5ef777fc6c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.390695 Aug 07 12:24:34.003937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 189/360] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:33 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:34.132997 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:34.141123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5856cea2-d154-4aae-ad6f-911f6bcfa547 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.400583 Aug 07 12:24:34.141705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 172/361] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:33 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:34.215251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:34.215999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:34.222211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:34.222694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:34.223174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:34.223892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:34.224342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:34.224794 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:34.307141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:34.317177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-517ce0ba-d239-4f71-944f-eb4e6a2d5e70 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1461 microversion: 2.1 time: 0.106427 Aug 07 12:24:34.318383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 190/362] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:34 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:35.031886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:35.035719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:35.058676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.060852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.061476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.064431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.064918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.065354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.100293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:35.175556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:35.176235 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:35.188272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.189095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.189721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.190645 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.191302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.192182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.373814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:35.395625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d513ecb2-6d4f-44f8-bf03-e5dcfa98cbc3 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.213947 Aug 07 12:24:35.404948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 191/363] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:35 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:35.430594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:35.430594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:35.431525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.432486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.433696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.434876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.435515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.436258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.479436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:35.480969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:35.482592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:35.483606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lazy-loading 'fault' on Instance uuid e698b8b9-c5b5-4a28-b65e-ac793eea2d0f {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:24:35.545107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:35.556525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-07bf68b5-eb19-44bd-a171-78287217da0c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 200 len: 1304 microversion: 2.1 time: 0.149623 Aug 07 12:24:35.569436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 192/364] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:35 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 1304 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:35.777961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:35.789830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:35.794635 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:35.797302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7f5d5c0a-983a-4997-a50e-e1fffc7646fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.771945 Aug 07 12:24:35.813128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 173/365] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:35 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:36.117839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:36.132430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.133145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.133746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.138896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:36.157254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] Creating event network-changed:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:24:36.161384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-c416891a-681c-49ed-8a79-cf75776851d0 req-96223fbf-0ed7-4167-b5f5-db743fd5488d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051058 Aug 07 12:24:36.162529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 193/366] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:36.420222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:36.424379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:36.446798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.447371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.447812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.448574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.449255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.449909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.586393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:36.588711 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: e698b8b9-c5b5-4a28-b65e-ac793eea2d0f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:36.595690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.596198 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.596639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.597341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.597798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.598225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.618190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] HTTP exception thrown: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Request method failure captured: Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f HTTP/1.1 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi767TyVwmEOFfk1xChevkwk9fecQvVKpf1J1nreJNcDh-XYxHJ9KIsMTahiVNcksMuYbD2XOKjkDU7cl3OVpDrdYSHheKk-SrDFtaQrndIo2uEYWhbj4Rgo7teK5ml460E8c1xVXjcygsDh3Cr6V9NuFixUJaOCyNOfo9EdTuzhCfYYo Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 74e6b27298e34383acb124fd4fc56918 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesActionsTest-1466826304 Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:24:36.622371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74e6b27298e34383acb124fd4fc56918", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesActionsTest-1466826304 Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 74e6b27298e34383acb124fd4fc56918 Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesActionsTest-1466826304 Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesActionsTest-1466826304-project Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 522765afd64c4018baebae36facfc3f3 Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesActionsTest-1466826304-project Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. Aug 07 12:24:36.624020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'e698b8b9-c5b5-4a28-b65e-ac793eea2d0f'} Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:24:36.625072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. Aug 07 12:24:36.626519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:36.629308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Returning 404 to user: Instance e698b8b9-c5b5-4a28-b65e-ac793eea2d0f could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:24:36.632038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7b9759a7-7b76-4f62-a21e-ccd1d25c469c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f" status: 404 len: 111 microversion: 2.1 time: 0.055296 Aug 07 12:24:36.632830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 194/367] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:36 2022] GET /compute/v2.1/servers/e698b8b9-c5b5-4a28-b65e-ac793eea2d0f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:24:36.756472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:36.769384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f56332c9-99d7-4243-b8e3-4ea299019276 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.360581 Aug 07 12:24:36.773408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 174/368] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:36 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:36.829410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:36.829875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-876901335", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "networks": [{"uuid": "87afe721-ec24-4d63-9fd8-b38ac630c7e8"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:36.830886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:36.843197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.843970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.845054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.846063 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:36.846758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:36.847604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:36.925763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] validate_networks() for [('87afe721-ec24-4d63-9fd8-b38ac630c7e8', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:24:37.093036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:37.101370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:37.102783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:37.124133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-41ff4bdc-1011-4e25-95cd-7d6a57875b04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.289974 Aug 07 12:24:37.124133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 175/369] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:36 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:37.436152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:24:37.436610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:24:37.437176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:24:37.437672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:24:37.438107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:24:37.449334 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:37.462915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:37.462915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:37.462915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:37.462915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:37.465090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:37.485770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Getting quotas for project 74e6b27298e34383acb124fd4fc56918. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:37.509413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Getting quotas for user 522765afd64c4018baebae36facfc3f3 and project 74e6b27298e34383acb124fd4fc56918. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:37.539364 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:24:37.541776 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:24:37.734031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3759d523-81dc-45b5-83a6-5ee3a61f6ea8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914008 Aug 07 12:24:37.737487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 195/370] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:24:37.754326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e9b50626-5bdd-4b2b-b546-4e8d81583b86 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:37.755686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e9b50626-5bdd-4b2b-b546-4e8d81583b86 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:37.791888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:37.793571 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:37.827552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:37.828715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:37.829349 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:37.832954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:37.834262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:37.836337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:37.876601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e9b50626-5bdd-4b2b-b546-4e8d81583b86 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:37.892954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e9b50626-5bdd-4b2b-b546-4e8d81583b86 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1213 microversion: 2.1 time: 0.147758 Aug 07 12:24:37.894188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 176/371] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:37 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:38.109009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:38.119701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7f34f883-75cb-4e0e-85db-16401829fcbb tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.331960 Aug 07 12:24:38.120441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 196/372] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:37 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:38.143406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:38.143406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:38.149476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:38.150010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:38.150451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:38.151196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:38.152482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:38.152906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:38.516802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:38.536200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:38.538050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:38.541041 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-763501c0-46bf-464c-932c-bc15dd1bc32c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.404549 Aug 07 12:24:38.547699 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 177/373] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:38 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:38.915704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b5dd42e9-ff7c-4770-8237-b5dff7cc77b2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:38.919755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b5dd42e9-ff7c-4770-8237-b5dff7cc77b2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:39.049026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b5dd42e9-ff7c-4770-8237-b5dff7cc77b2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:39.056593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b5dd42e9-ff7c-4770-8237-b5dff7cc77b2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1213 microversion: 2.1 time: 0.145324 Aug 07 12:24:39.059186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 197/374] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:38 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:39.143178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:39.143782 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:39.154345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:39.155133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:39.155748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:39.159194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:39.159805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:39.160650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:39.440875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:39.452778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-72162dd6-9be1-4551-826b-2b7291f5308d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.315355 Aug 07 12:24:39.453373 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 178/375] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:39 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:39.572724 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:39.573928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:39.588821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:39.599787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:39.600604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:39.601575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:39.602245 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:39.602904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:39.901036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:39.914167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:39.918141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:39.924510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-87be1348-7bda-4144-bda7-20e0eb4eb6e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.355634 Aug 07 12:24:39.925350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 198/376] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:39 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:24:40.079996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:40.080662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:40.103021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.109973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.109973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:40.110818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.111887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.115682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:40.321828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:40.341119 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5d7c8fa7-38ff-4519-a7f5-1024ea959c78 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1209 microversion: 2.1 time: 0.266575 Aug 07 12:24:40.342266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 179/377] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:40 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1209 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:40.477593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:40.478729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:40.487800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.488714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.489477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:40.490548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.491260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.491917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:40.942611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:40.958717 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:40.962555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:40.976726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-61b99fec-f2c4-4c33-8bc3-4b809d402909 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.506432 Aug 07 12:24:40.979029 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.979388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.980455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:40.981454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:40.991477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 199/378] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:40 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:40.992907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:40.993518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:41.211325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:41.224661 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:41.226374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:41.231288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1bc5eade-14e5-40b6-ae3a-367cb168cf45 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.280655 Aug 07 12:24:41.236860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 180/379] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:40 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:41.373678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:41.374286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:41.380324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:41.381027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:41.381458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:41.382150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:41.382596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:41.383028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:41.470918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:41.485524 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7cb8c218-59e9-4b0c-bed9-47642057d4a9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1265 microversion: 2.1 time: 0.115654 Aug 07 12:24:41.486299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 200/380] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:41 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:42.002772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:42.004184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:42.016043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.016996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.018011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.018961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.019668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.020343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.201996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:42.210016 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ea1d9020-1f11-4680-aa38-67bd2699e548 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.211824 Aug 07 12:24:42.210610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 181/381] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:41 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:42.266326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:42.267028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:42.273905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.274749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.275375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.280634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.281308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.282352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.462758 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:42.472001 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:42.473594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:42.474883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-03b9e913-6601-4df6-9546-dba6a1c6ed13 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1739 microversion: 2.20 time: 0.214073 Aug 07 12:24:42.475528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 201/382] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:42 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:42.505905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:42.506657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:42.512772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.513258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.513943 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.514627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:42.515324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:42.515747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:42.586517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:42.594800 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-709eabec-d62f-4b4a-820c-6d700069c174 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1273 microversion: 2.1 time: 0.092844 Aug 07 12:24:42.595414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 182/383] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:42 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:43.234759 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:43.235580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:43.246140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.246884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.247531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.248278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.248896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.249320 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.422983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:43.434661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0b5b49d3-b457-4cdb-b94b-26205cac83fd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.202206 Aug 07 12:24:43.434661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 202/384] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:43 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:43.499721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:43.502825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:43.514960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.515501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.516530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.517245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.517696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.518112 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.623481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:43.624415 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:43.631570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.632370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.633190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.634114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.634785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.635459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.717856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:43.725582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cec333e1-46e1-4570-b193-e227764a6eac tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1271 microversion: 2.1 time: 0.110093 Aug 07 12:24:43.726968 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 203/385] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:43 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:43.732213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:43.732929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:43.749214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.749993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.750589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.751637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:43.752359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:43.753017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:43.922231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lazy-loading 'services' on Instance uuid dd67a2c0-dbe5-4118-b57f-dc7f73877d08 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:24:44.007311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:44.020512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:44.025348 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:44.029014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4fb26726-c944-43c7-a0c6-4366c9bd2a43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1721 microversion: 2.20 time: 0.533635 Aug 07 12:24:44.036348 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 183/386] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:43 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1721 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:44.253775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-33650fae-7b7c-4dd0-a984-85c5f4d591de tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08/os-volume_attachments/ce0fa32e-786b-4f53-9b58-9e170b58a409" status: 202 len: 0 microversion: 2.1 time: 0.525429 Aug 07 12:24:44.258707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 204/387] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:24:43 2022] DELETE /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08/os-volume_attachments/ce0fa32e-786b-4f53-9b58-9e170b58a409 => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:24:44.454067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:44.455192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:44.461986 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:44.462955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:44.464210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:44.465553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:44.466244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:44.466908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:44.696429 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:44.706007 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7e350474-9b72-4f47-9614-dc81bf82cc32 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.257365 Aug 07 12:24:44.706738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 184/388] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:44 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:44.747694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:44.748611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:44.756773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:44.757445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:44.757883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:44.758749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:44.759229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:44.761440 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:44.929169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:44.938783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e68f6781-8b46-496f-93f6-d8c8e8e07e51 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.196712 Aug 07 12:24:44.952455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 205/389] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:44 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:45.053880 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:45.054628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:45.063334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.064533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.065569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.066493 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.067552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.068192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.188136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3b323d3-b3f8-429c-9148-0faf9cdfba5d", "tag": "4fa27418-a9ea-40a6-a08c-7b7e8dad195e"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:45.198725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.199562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.200202 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.218617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] Creating event network-changed:4fa27418-a9ea-40a6-a08c-7b7e8dad195e for instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d on hv-cinder-84984 Aug 07 12:24:45.227279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-8f22a0a4-fcd0-4013-aa7f-156d7fcd9355 req-6f729b5d-60de-4dbc-b49d-edae11747ce8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043747 Aug 07 12:24:45.228403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 206/390] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:45.242324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "name": "network-vif-plugged", "status": "completed", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:45.253344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.259090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.259090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.272946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] Creating event network-vif-plugged:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:24:45.279982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-4f7d893b-5b46-4f8d-a088-3743cbdd6591 req-d4dab0cf-7dd0-44e8-a328-34ac96f0578d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048548 Aug 07 12:24:45.283267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 207/391] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:45.577042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:45.587563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:45.590326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:45.592228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6846cbeb-6af5-4b51-9491-d6f7498390d8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1721 microversion: 2.20 time: 0.542199 Aug 07 12:24:45.597071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 185/392] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:45 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1721 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:45.731514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:45.732442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:45.740642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.741369 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.741971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.742825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.743453 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.744034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.896774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:45.907949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ed6388ba-d381-4423-b352-8b493768341a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.180581 Aug 07 12:24:45.909175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 208/393] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:45 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:45.961900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:45.962541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:45.969697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.970403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.971080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:45.972009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:45.972458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:45.972880 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:46.117117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:46.125688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e10345f9-6c28-4af9-8b5d-899500250d0d tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.167781 Aug 07 12:24:46.139300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 186/394] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:45 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:46.619249 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:46.619854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:46.627481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:46.627481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:46.627765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:46.628386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:46.628843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:46.629371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:46.783246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:46.793435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:46.795037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:46.796249 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8f0d097a-df87-4173-9e34-f1dfa5b0da90 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1721 microversion: 2.20 time: 0.181073 Aug 07 12:24:46.796828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 209/395] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:46 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:46.929234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:46.929866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:46.936589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:46.937899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:46.937899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:46.938748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:46.939390 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:46.939967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.147753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:47.148361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:47.155674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:47.156125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:47.156567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.157648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:47.157782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:47.158136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.231697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:47.245336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ddfd76c5-a370-4586-9263-5a3c7832d993 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.319663 Aug 07 12:24:47.266187 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 187/396] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:46 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:47.337984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "name": "network-vif-unplugged", "status": "completed", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:47.351425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:47.352124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:47.353755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.376427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] Creating event network-vif-unplugged:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:24:47.383433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-775f4ce6-3a7c-414e-b032-b4e6fa1d9e71 req-cea9ffce-da13-48b8-bc16-33329d866714 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049033 Aug 07 12:24:47.384050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 188/397] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:47.402681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:47.411271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7acfbdfa-0dd5-4f07-91e4-441bf8107f2c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.267801 Aug 07 12:24:47.418913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 210/398] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:47 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:47.835205 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:47.835917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:47.843862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:47.844360 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:47.844853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.845567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:47.846062 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:47.846473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:47.883610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:48.024620 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:48.034817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:48.034817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:48.036289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a727f67c-18e0-448d-8276-98063eb0a289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1724 microversion: 2.20 time: 0.218795 Aug 07 12:24:48.046908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 189/399] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:47 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:48.060486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "128707c4-31a5-4b0c-9945-6cab6505be32"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:48.063239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:48.065281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:48.071469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.072278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.073226 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.074149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.074785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.075304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.267503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:48.268095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:48.277215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.285116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.285116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.285116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.285116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.285555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.447272 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:48.458899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-82ab0539-f76f-4ed4-a6f4-e2482586ff17 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1371 microversion: 2.1 time: 0.195431 Aug 07 12:24:48.471827 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 190/400] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:48 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:48.479315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:48.479315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:48.485890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.486602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.487275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.488139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.488738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.489305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.831495 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:48.835732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:48.841844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-230ca716-9013-4f4d-a9aa-283dc67e4ef2 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.368381 Aug 07 12:24:48.842896 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 191/401] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:48 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:48.866133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:48.869219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:48.877220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.877800 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.878340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.879180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:48.880517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:48.880517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:48.902837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:48.920556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:24:49.055828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=8 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:49.264098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-75653676-f807-453a-afd8-3f4a41a26978 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 204 len: 0 microversion: 2.1 time: 0.419048 Aug 07 12:24:49.265067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 192/402] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:24:48 2022] DELETE /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:24:49.273762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:49.279732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.283510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.284102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.284608 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.285543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.286053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.286538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.326192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7c4e5aa3-8bc5-4538-84a4-ed3a9d7569fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.270977 Aug 07 12:24:49.334910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 211/403] 10.222.0.30 () {62 vars in 1364 bytes} [Sun Aug 7 12:24:48 2022] POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments => generated 188 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:24:49.500951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:49.500951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.501474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:49.516236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.516725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.517168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.517900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.518348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.518768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.523355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6621c9af-03d6-44d9-97e5-bbb5272ca8e4 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1513 microversion: 2.1 time: 0.253734 Aug 07 12:24:49.524234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 193/404] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:49 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:49.530528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:49.531140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.561883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.562416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.567665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.571283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.572161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.572604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.683831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118243) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 12:24:49.782929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:49.805795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-93930b8b-c9a3-43dc-bc0d-be565096dc79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1566 microversion: 2.1 time: 0.324860 Aug 07 12:24:49.807164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 212/405] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:49 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1566 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:49.831036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:49.831036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.836074 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.842138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.842138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.842138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.842138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.842635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.871564 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c1eb98a8-1f08-4e55-91fe-cb4e7d87268f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/ips" status: 200 len: 150 microversion: 2.1 time: 0.062576 Aug 07 12:24:49.871891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 213/406] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:24:49 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/ips => generated 150 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:49.891231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:49.891231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.891231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.891231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.892214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.892214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.892214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.892214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.975989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2afabcdd-b4e7-4eaa-8e9b-855905f9650c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103021 Aug 07 12:24:49.983960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 214/407] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:24:49 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:49.988805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:49.989521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:49.997041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.997609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:49.998058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:49.998755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:49.999228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:50.000082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:50.164247 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:50.173034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9655eff9-08d3-4515-9500-ad24792a0cc7 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.187956 Aug 07 12:24:50.173852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 215/408] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:49 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:50.526263 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fefc7817-9f42-4147-ad7f-80410bf78b83 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/action" status: 202 len: 0 microversion: 2.20 time: 1.000858 Aug 07 12:24:50.530262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 194/409] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 12:24:49 2022] POST /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/action => generated 0 bytes in 1003 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:24:50.536168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:50.536778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:50.543250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:50.543903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:50.544353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:50.545091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:50.545551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:50.545979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:50.560662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:50.561274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:50.567220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:50.567709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:50.568138 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:50.568830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:50.569272 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:50.569807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:50.723294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:50.732518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:50.733859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:50.735054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b50cb062-1fe0-4785-90c7-9abd0c4bc1bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1750 microversion: 2.20 time: 0.202758 Aug 07 12:24:50.743560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 216/410] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:50 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:50.852914 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:50.864311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-504135e4-af44-451a-940d-edd6aa7cece2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1513 microversion: 2.1 time: 0.307743 Aug 07 12:24:50.865105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 195/411] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:50 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:51.196266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:51.196893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:51.204478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.205196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.205782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.206842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.207459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.208152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.372654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:51.390733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.391497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.392153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.403483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:51.404788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] Creating event network-changed:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:24:51.410368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-ff281ab0-1146-4529-80ba-f8c4af7db89e req-32101a80-3bd0-4cfa-a00a-7f8e0bf1c498 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046355 Aug 07 12:24:51.411411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 196/412] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:51.414056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-462e5a32-103a-40c5-b6a6-bc5cb867cc41 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.221759 Aug 07 12:24:51.414628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 217/413] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:51 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:51.750024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3dc61fd8-4edd-48a0-b242-25bd84d7aafb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'create', calling method: .version_select at 0x7f77a413cc10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1215802531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA4GJY9HM1i9w6kBcz1ePr999M/LsbOUePS0fu+kKBhkB5w0LnnWTL3elZupzzq8+birmRnadi7xQByyBz4Iijlqj4U+xarOcUwUryqmEb5nnAIYNSSRYbAlvb7OD33jw=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:51.766727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:51.767322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3dc61fd8-4edd-48a0-b242-25bd84d7aafb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Getting quotas for project 006bf6eb97a14d8c8c33f880b0bb80bc. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:51.772791 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:51.772944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3dc61fd8-4edd-48a0-b242-25bd84d7aafb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Getting quotas for user c62c3bfffc214c57a1f48b2779a615ac and project 006bf6eb97a14d8c8c33f880b0bb80bc. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:51.787856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:51.789378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.790313 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.791580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.793245 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.793845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.794286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.876807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3dc61fd8-4edd-48a0-b242-25bd84d7aafb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.131413 Aug 07 12:24:51.883634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 197/414] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:24:51 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:51.891862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:51.895445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:51.908653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.909405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.909955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.910876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:51.911550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:51.912144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:51.953574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:51.962839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:51.965258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:51.966496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a012af43-61aa-46f1-955c-a97c4cb75674 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1750 microversion: 2.20 time: 0.207429 Aug 07 12:24:51.967101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 218/415] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:51 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1750 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:51.972149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1335128256", "imageRef": "e7e852e3-2738-480f-ab5f-3b27496b2026", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1215802531", "networks": [{"uuid": "133f52a5-7e79-4169-92bc-44eebe7aacc4"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:52.041301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] validate_networks() for [('133f52a5-7e79-4169-92bc-44eebe7aacc4', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:24:52.087729 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:52.130780 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f70d0b51-d268-47ce-89d5-db18538f728e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1513 microversion: 2.1 time: 0.243994 Aug 07 12:24:52.132907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 198/416] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:51 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:52.187946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edae3f32-db97-4d63-9806-940ae065c9f1"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:52.190608 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:52.199973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.200727 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.201396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.202319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.203184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.203968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.453924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:24:52.454428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:24:52.454834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:24:52.455289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:24:52.455700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:24:52.465359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.465839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.466264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.466983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.467520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.467944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.485084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Getting quotas for project 006bf6eb97a14d8c8c33f880b0bb80bc. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:24:52.487279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:52.489650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Getting quotas for user c62c3bfffc214c57a1f48b2779a615ac and project 006bf6eb97a14d8c8c33f880b0bb80bc. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:24:52.501034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:24:52.503278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e7e852e3-2738-480f-ab5f-3b27496b2026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:24:52.646085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-14ed3383-eb19-4675-b4d3-5c4ac2927363 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677561 Aug 07 12:24:52.646840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 219/417] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:24:52.651997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:52.652743 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:52.659031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.659596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.660111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.660875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.661382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.661807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.846058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:52.854040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0b6f4278-9d83-4224-8a03-c563a84dd42c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.206103 Aug 07 12:24:52.854682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 220/418] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:52 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:52.859121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fbce0c67-1840-45d0-8e7e-196d05c22ba9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:52.859903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fbce0c67-1840-45d0-8e7e-196d05c22ba9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:52.920689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fbce0c67-1840-45d0-8e7e-196d05c22ba9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:52.927956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fbce0c67-1840-45d0-8e7e-196d05c22ba9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1259 microversion: 2.1 time: 0.072261 Aug 07 12:24:52.928533 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 221/419] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:52 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:52.990158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:52.990900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:52.997781 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:52.998417 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:52.998920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:52.999712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.000268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.000765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.209304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:53.222013 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:53.235293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:53.235293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ce4966d1-25a5-4073-b68f-e8015fe9f7d4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1750 microversion: 2.20 time: 0.239557 Aug 07 12:24:53.235293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 222/420] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:52 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1750 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:24:53.235293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:53.236283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:53.238512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.239306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.239933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.240854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.241557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.242180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.424506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:53.439738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3ae6952d-0f88-46c1-bc74-d441fb45d61b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1513 microversion: 2.1 time: 0.213100 Aug 07 12:24:53.442367 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 223/421] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:53 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:53.568718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e29b384b-3142-4ac2-a21b-6f07e1de617b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.384567 Aug 07 12:24:53.569643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 199/422] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:24:52 2022] POST /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments => generated 194 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:24:53.875922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:53.876532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:53.884458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd67a2c0-dbe5-4118-b57f-dc7f73877d08", "name": "network-vif-deleted", "tag": "60e58be3-95b0-4385-be72-29086cd43dc3"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:53.894363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.895356 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.902634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.902634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.902634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.902634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.903083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:53.903083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:53.903083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:53.919060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] Creating event network-vif-deleted:60e58be3-95b0-4385-be72-29086cd43dc3 for instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 on hv-cinder-84984 Aug 07 12:24:53.924258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-5190f0ba-65de-4a50-a1bd-fc6a4e81ab11 req-3c299555-b469-4c0f-ab79-0eaf4aaa6ca9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043685 Aug 07 12:24:53.925150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 200/423] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:53.950420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-25e161a9-b149-4579-971a-da217b78132b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:53.957204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-25e161a9-b149-4579-971a-da217b78132b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:54.040496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-25e161a9-b149-4579-971a-da217b78132b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.048176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-25e161a9-b149-4579-971a-da217b78132b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1259 microversion: 2.1 time: 0.102681 Aug 07 12:24:54.051692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 201/424] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:53 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1259 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:24:54.094769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.101654 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b42099df-9981-4ab7-8693-642184099c24 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.229701 Aug 07 12:24:54.102225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 224/425] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:53 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:54.249213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:54.249726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:54.256343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:54.256823 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:54.257249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:54.257928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:54.258392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:54.258818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:54.390152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.398510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.400054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.401219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a6b8f3b7-46f9-4db7-b88a-589694707b97 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1752 microversion: 2.20 time: 0.156597 Aug 07 12:24:54.401764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 202/426] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:54 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:54.463284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:54.463895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:54.470469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:54.470952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:54.471413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:54.472390 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:54.472680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:54.473027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:54.504292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:54.504706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:54.505138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:54.505617 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lazy-loading 'fault' on Instance uuid dd67a2c0-dbe5-4118-b57f-dc7f73877d08 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:24:54.551148 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:54.558940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dae2fe4b-8ae1-4411-8f20-b32bc11b2bd9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 200 len: 1308 microversion: 2.1 time: 0.099553 Aug 07 12:24:54.559534 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 225/427] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:54 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:55.071479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:55.072095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:55.083293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.083293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.083293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.083293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.083641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.083641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.123642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:55.124547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:55.131418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.132504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.135026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.135026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.135026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.135026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.150451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:55.160319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8fc1d825-6ee2-472d-9031-aee133a1a781 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1311 microversion: 2.1 time: 0.093072 Aug 07 12:24:55.163690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 203/428] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:55 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:55.247497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b323d3-b3f8-429c-9148-0faf9cdfba5d", "name": "network-vif-plugged", "status": "completed", "tag": "4fa27418-a9ea-40a6-a08c-7b7e8dad195e"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:24:55.258734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.259237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.259670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.272174 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] Creating event network-vif-plugged:4fa27418-a9ea-40a6-a08c-7b7e8dad195e for instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d on hv-cinder-84984 Aug 07 12:24:55.277121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-11387f63-f664-40be-bf27-337360c89e2a req-cc2ee406-704a-47c8-8baf-aefd4984072f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Aug 07 12:24:55.278484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 204/429] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:24:55.288799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:55.297532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-42fb65ba-7dd6-4028-b9f4-41ffbc0b8eb5 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.178356 Aug 07 12:24:55.298113 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 226/430] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:55 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:55.428257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:55.428943 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:55.435874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.436357 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.436794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.437473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.438032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.438444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.576764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:55.579840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:55.580785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: dd67a2c0-dbe5-4118-b57f-dc7f73877d08] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:55.585594 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:55.586678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.587215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.592611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:55.592771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.592771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:55.592985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f48fec1c-cacf-4ade-9639-09c810601522 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1752 microversion: 2.20 time: 0.164370 Aug 07 12:24:55.593085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:55.593175 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 205/431] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:55 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:55.593263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:55.602922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] HTTP exception thrown: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Request method failure captured: Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 HTTP/1.1 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi766jEP8-L7Itg_-EEL6IKCd3ZL30vRl-7ezEj3FSNO1iFPl8_CLkWsLGAzEa3xZITj9llpjSonvXpcRsGP11mqo8Y7jcrBwgNk8s0SJvVXrzLOCmecXUj1WIcGx1qvG3-n1b_ehrz0H8iuR02BbAK8K5s5IqEZrCDIbDuitLb6Z0lW0 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 7bdb62eaaade46ffa205828d13dba7be Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:24:55.604690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7bdb62eaaade46ffa205828d13dba7be", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 7bdb62eaaade46ffa205828d13dba7be Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesSnapshotTestJSON-591063941-project Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: b68f7224855a4cec81b664a2573d60f1 Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesSnapshotTestJSON-591063941-project Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. Aug 07 12:24:55.607602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'dd67a2c0-dbe5-4118-b57f-dc7f73877d08'} Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:24:55.608667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. Aug 07 12:24:55.610269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:24:55.611695 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Returning 404 to user: Instance dd67a2c0-dbe5-4118-b57f-dc7f73877d08 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:24:55.611695 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cbe589de-ac2e-40e0-977b-4102ed59b3f7 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08" status: 404 len: 111 microversion: 2.1 time: 0.031724 Aug 07 12:24:55.611695 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 227/432] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:55 2022] GET /compute/v2.1/servers/dd67a2c0-dbe5-4118-b57f-dc7f73877d08 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:24:56.181996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:56.182593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:56.189406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.189875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.190306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.190994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.191466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.191882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.255224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:56.263269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-22851d93-fbdf-4d55-a03f-5cac20333910 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1319 microversion: 2.1 time: 0.085325 Aug 07 12:24:56.264095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 206/433] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:56 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1319 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:56.319201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:56.319830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:56.326493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.326965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.327419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.328094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.328539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.328952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.457276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:56.465611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f0ca0266-a0a9-428a-86e7-f42e3c406887 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.150304 Aug 07 12:24:56.466177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 228/434] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:56 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:56.614720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:56.615284 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:56.621709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.622223 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.622653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.623379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:56.623823 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:56.624240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:56.753298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:56.762291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:56.764087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:56.765243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e2b63f66-b0a2-4952-85dd-af6b34902193 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.154546 Aug 07 12:24:56.765809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 207/435] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:56 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:57.283600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:57.284204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:57.290194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.290670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.291140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.291817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.292292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.293258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.357566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:57.364985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-11602543-3ecb-4734-a0cd-bf4aeb674f6b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1329 microversion: 2.1 time: 0.085239 Aug 07 12:24:57.365549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 229/436] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:57 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:57.485968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:57.486581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:57.493004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.493480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.493911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.494591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.495087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.495492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.515336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:57.628100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:57.635342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f5030afe-8cd0-495d-aefd-873d7784a71a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.153147 Aug 07 12:24:57.635913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 208/437] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:57 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:57.787951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:57.788561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:57.794413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.794918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.795388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.796103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:57.796553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:57.796973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:57.800835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:24:57.928006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:57.936822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:57.938316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:57.939511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8963a922-705d-47e9-acfa-2faf1270ca2d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.155431 Aug 07 12:24:57.940061 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 230/438] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:57 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:58.386056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:58.386835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:58.393336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.393807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.394236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:58.394910 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.395383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.395841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:58.456545 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:58.463895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b679d7c8-530a-46ed-b81d-2607943cfe48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1329 microversion: 2.1 time: 0.082156 Aug 07 12:24:58.465097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 209/439] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:58 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1329 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:58.656392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:58.656995 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:58.663058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.663512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.663938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:58.664614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.665062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.665481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:58.791363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:58.799246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7be52e00-a708-4e39-9e11-e561558046de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.146704 Aug 07 12:24:58.799805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 231/440] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:58 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:58.961767 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:58.962441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:58.969735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.970320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.970826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:58.971624 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:58.972145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:58.972642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:59.119760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:59.129105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:59.130594 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:59.131991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c0485877-4d15-422a-a12f-200200425723 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.174240 Aug 07 12:24:59.132541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 210/441] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:24:58 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:24:59.485571 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:59.486270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:59.492186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:59.492768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:59.493269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:59.494008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:59.494461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:59.494880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:59.564010 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:24:59.571503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b30040e9-1ef7-4a91-871f-9f8d773c2ed7 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1329 microversion: 2.1 time: 0.089727 Aug 07 12:24:59.572069 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 232/442] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:59 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:24:59.819994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:24:59.824575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:24:59.826611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:59.827140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:59.827568 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:24:59.828256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:24:59.828701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:24:59.829117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:00.033808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:00.041311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b8ece7ae-8c07-49f9-860d-d8606bf7be90 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1313 microversion: 2.1 time: 0.225139 Aug 07 12:25:00.041957 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 211/443] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:24:59 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:00.157863 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:00.158581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:00.164872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:00.170972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:00.170972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:00.170972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:00.170972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:00.171341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:00.356156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:00.365381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:00.366895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:00.368154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2894c2d7-741e-46aa-892c-39ae78173734 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.216642 Aug 07 12:25:00.368723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 233/444] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:00 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:00.593639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:00.594575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:00.603478 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:00.605270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:00.606761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:00.607528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:00.611639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:00.612264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:00.877915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:00.888120 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1bb9d443-467c-4246-962e-919ea2cf93fb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.300057 Aug 07 12:25:00.888696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 212/445] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:00 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:01.063066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:01.063742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:01.070329 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.070820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.071292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.072016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.072445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.072866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.267993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:01.275742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1857b840-ffe0-40f5-b6ef-c1db64cd054a tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1496 microversion: 2.1 time: 0.217662 Aug 07 12:25:01.283540 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 234/446] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:01 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:01.392784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:01.394042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:01.401080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.401688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.402990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.403719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.404438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.405026 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.500621 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:01.510923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.512381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.513438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.550286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] Creating event network-changed:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:25:01.556169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-13c7ef7e-5a33-489c-a0a2-36fe852f8001 req-85d91edb-201d-4bdf-bbfc-1785c8d66e61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059097 Aug 07 12:25:01.556776 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 235/447] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:01.621535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:01.630656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:01.632289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:01.633560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b0ad416d-7a9b-4124-977a-380c75af6bb9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.245092 Aug 07 12:25:01.634199 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 213/448] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:01 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:01.913982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:01.914625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:01.921808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.922298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.924480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:01.924480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:01.924480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:01.924480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.083289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:02.091840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ae6c6eb5-8697-4f51-9d7d-a3b6eabc1b5b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.182098 Aug 07 12:25:02.110282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 236/449] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:01 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:02.265121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:02.265628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:02.272023 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.272581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.273030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.275122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.275644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.276229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.309551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:25:02.623973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d2819981-2992-4498-ab25-2b81aff38c37 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 204 len: 0 microversion: 2.1 time: 0.363143 Aug 07 12:25:02.628392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 214/450] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:25:02 2022] DELETE /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:25:02.633347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:02.633956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:02.635969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:02.641307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.644783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.644783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.644783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.644783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.645151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.659783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:02.660512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:02.667236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.668990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.669606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.670473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:02.671123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:02.671719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:02.807556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:02.817605 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-45045d73-b5d1-45e6-aff3-ef37fba3122c tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.188218 Aug 07 12:25:02.822100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 237/451] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:02 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:02.838292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:02.848386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:02.850116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:02.851415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6a32d361-25c3-46bb-8227-87c31a09d424 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.196028 Aug 07 12:25:02.852072 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 215/452] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:02 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:03.115019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:03.115736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:03.117865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=8 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:03.122877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.123467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.123904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:03.124599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.125051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.125475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:03.269727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:03.312234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3e550af6-21ee-4230-9344-f071f76b495e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.176544 Aug 07 12:25:03.312234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 238/453] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:03 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:03.840788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:03.841388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:03.847781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.848264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.848697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:03.849380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.849879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.850309 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:03.879592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:03.880316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:03.887193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.890799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.890799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:03.890799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:03.890799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:03.891215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:04.026918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:04.038267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8418fa02-d97a-4f6e-bd96-f7a983f69010 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.201538 Aug 07 12:25:04.041256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 216/454] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:03 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:04.047199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:04.056396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:04.057908 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:04.059984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f45d1add-a792-4bb1-8d49-2cfe11e05d9e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.184170 Aug 07 12:25:04.060754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 239/455] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:03 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:04.324179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:04.325142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:04.327296 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:04.332111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:04.332597 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:04.333030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:04.333787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:04.334239 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:04.334657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:04.484982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:04.496891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b2bba581-adc6-48ae-bb61-71d9b68dbf27 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.176561 Aug 07 12:25:04.497747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 217/456] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:04 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:05.059843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:05.060457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:05.067453 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.067968 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.068502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.069332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.069798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.070342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.083751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:05.085066 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:05.113679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.113679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.113679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.113679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.114552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.114552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.219370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:05.226748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0cbe27a6-8311-4e57-93bc-3722a64a757b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.171315 Aug 07 12:25:05.227373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 240/457] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:05 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:05.262660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:05.271695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:05.273214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:05.274381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-be41d4cf-631f-4545-a471-624a4dbd3998 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.194536 Aug 07 12:25:05.274938 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 218/458] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:05 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:05.519148 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:05.520024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:05.526300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.527046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.527253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.528197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:05.528651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:05.529102 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:05.682916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:05.698279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9168ab74-7e92-4f4c-8b9b-5177e27e87fe tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.184304 Aug 07 12:25:05.698896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 241/459] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:05 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:06.251285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:06.252737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:06.256569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-164954450", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "networks": [{"uuid": "069fd451-f41e-4c1b-953e-cc6be62df051"}]}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:06.260971 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.268497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.268497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.268497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.268497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.269090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.321338 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] validate_networks() for [('069fd451-f41e-4c1b-953e-cc6be62df051', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:25:06.429596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:06.437798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1fae41c2-85e9-43de-9452-c566402c903f tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.192469 Aug 07 12:25:06.438375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 219/460] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:06 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:06.444381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:06.445341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:06.459909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.460867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.461593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.462496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.463216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.463897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.621294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:06.631424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:06.644004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:06.645519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7051b98e-8fc7-454f-9ade-2204000e7ce5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.205548 Aug 07 12:25:06.646409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 220/461] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:06 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:06.724735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:06.726177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:06.733264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:25:06.733470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.734057 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.734283 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:25:06.734507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.734946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:25:06.735241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.735703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.735826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:25:06.736130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.736407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:25:06.746200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.747079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.747747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.748720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:06.749408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:06.750068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:06.769127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Getting quotas for project 7bdb62eaaade46ffa205828d13dba7be. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:25:06.773249 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Getting quotas for user b68f7224855a4cec81b664a2573d60f1 and project 7bdb62eaaade46ffa205828d13dba7be. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:25:06.786298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:25:06.788704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:25:06.904639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:06.913082 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9c66415a-a651-4ae3-ae5c-35d365ab8cf9 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.197249 Aug 07 12:25:06.926570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 221/462] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:06 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:06.931168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-601d30b2-7aab-4223-b6c4-289c562fac48 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676553 Aug 07 12:25:06.931168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 242/463] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:25:06.943294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-48d31221-dc6a-4f7c-991d-395732347d9c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:06.944036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-48d31221-dc6a-4f7c-991d-395732347d9c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:07.007411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-48d31221-dc6a-4f7c-991d-395732347d9c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:07.017051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-48d31221-dc6a-4f7c-991d-395732347d9c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1218 microversion: 2.1 time: 0.077752 Aug 07 12:25:07.031717 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 222/464] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:06 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:07.459928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:07.460691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:07.467067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.467737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.468158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:07.469051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.469499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.469919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:07.624689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:07.632526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1e847fde-78d4-4595-8948-c3e078bd5192 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.177165 Aug 07 12:25:07.633134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 243/465] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:07 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:07.675795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:07.676435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:07.682762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.683299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.683743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:07.684429 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.684878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.685303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:07.842868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:07.852690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:07.854373 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:07.856301 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d093e457-57f6-4c5c-ae9f-6087cce82c71 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.184472 Aug 07 12:25:07.856886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 223/466] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:07 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:07.933308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:07.934040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:07.940035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.940514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.940944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:07.941625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:07.942070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:07.942490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.040087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:08.040977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:08.052685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.053449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.053881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.054583 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.055054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.055539 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.079659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:08.088108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:08.096472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2a2a467c-6f47-4648-abe7-8dd8e1e38207 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.166943 Aug 07 12:25:08.097067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 244/467] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:07 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:08.135968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:08.138908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c816431d-310d-4480-b5f2-27cd2d2575c9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1222 microversion: 2.1 time: 0.102634 Aug 07 12:25:08.139974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 224/468] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:08 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:08.654796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:08.655460 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:08.661845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.662425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.662944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.663817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.664469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.665005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.803676 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:08.812017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-667feb12-5671-484b-ad37-a85eef59d349 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.161067 Aug 07 12:25:08.812800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 245/469] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:08 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:08.879216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:08.880688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:08.889563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.890504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.891191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:08.892154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:08.892792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:08.893412 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.063319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:09.072632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:09.074747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:09.076005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f9dccbb0-e054-4098-9ba2-8bd7ebebdda5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.200761 Aug 07 12:25:09.076569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 225/470] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:08 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:09.127624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:09.128527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:09.135849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.136976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.137659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.138461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.144078 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.144520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.160664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:09.161765 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:09.170109 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.171238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.171815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.173031 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.173536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.174006 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.257643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:09.266757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2163d0fb-7b2d-4949-a6b9-ac86c36a99e0 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1222 microversion: 2.1 time: 0.110327 Aug 07 12:25:09.271394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 226/471] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:09 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:09.317184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:09.327253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-11cb0f09-34fd-449c-ab3c-5f755861bf69 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.212822 Aug 07 12:25:09.328535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 246/472] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:09 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:09.836167 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:09.837387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:09.847434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.848012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.848910 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.849774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:09.850311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:09.850946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:09.996369 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.004170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e97a7792-babe-40f3-afdb-cccd17b409e6 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.173872 Aug 07 12:25:10.004743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 227/473] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:09 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:10.100058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:10.100696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:10.107228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.107724 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.108165 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.108881 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.109526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.109957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.260156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.269267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.270840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.272038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-78c38ff6-21ac-4964-a329-7259d07548fa tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.176276 Aug 07 12:25:10.272774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 247/474] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:10 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:10.292376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:10.293807 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:10.300054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.300541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.300980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.301740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.302195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.302618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.349484 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:10.350562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:10.357250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.357729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.358160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.358858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:10.359327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:10.359747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:10.364503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:10.367123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.375145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d90d4061-119a-4415-937a-b3230c6f98e3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1222 microversion: 2.1 time: 0.086686 Aug 07 12:25:10.376757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 228/475] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:10 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:10.502563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:10.510485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-af387b41-d5f3-4413-819c-2ce2cccbc768 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.164810 Aug 07 12:25:10.519038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 248/476] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:10 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:11.025677 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:11.026291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:11.033178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.033658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.034094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.034783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.035270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.035698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.164198 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.172213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-947b4452-8978-4e87-b55f-6a05eb1a6297 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.150391 Aug 07 12:25:11.172867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 229/477] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:11 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:11.296311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:11.296922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:11.302810 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.303326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.303761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.304476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.304942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.305351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.395236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:11.395863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:11.401899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.402378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.402816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.403536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.403997 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.404419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.437443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.446022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.447564 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.448773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1a9f93a4-841f-4728-96ac-0d47d416ae10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.157099 Aug 07 12:25:11.449369 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 249/478] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:11 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:11.465152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.472656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0e361a86-729d-4abe-afdf-88e335753cfa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1222 microversion: 2.1 time: 0.081295 Aug 07 12:25:11.473228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 230/479] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:11 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:11.532917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:11.533535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:11.539475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.539956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.540394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.541074 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:11.541526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:11.541950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:11.669986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:11.677472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ab1ebb9f-5f73-451a-ab06-4658383402d5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.148386 Aug 07 12:25:11.678126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 250/480] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:11 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:12.193531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:12.194251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:12.200759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.201242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.201676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.202359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.202809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.203304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.472017 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:12.472855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:12.479583 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.480652 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.481085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.481780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.482226 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.482687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.615332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.620957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.623536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6fb42b3b-f239-4a29-892b-1519afbdac7b tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.433836 Aug 07 12:25:12.624350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 231/481] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:12 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:12.628510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:12.629102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:12.634797 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.635437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.636059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.637057 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.637206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.637519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.637939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.638556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.640031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e98e2a82-839f-431e-9775-cbc60065caec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.172118 Aug 07 12:25:12.640756 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 251/482] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:12 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:12.699018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.699196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:12.699715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:12.705683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.706162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.706589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.706719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ffb5b263-ea49-4544-a627-58416b983c2b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1214 microversion: 2.1 time: 0.081561 Aug 07 12:25:12.707255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 232/483] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:12 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:12.707376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:12.707735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:12.708154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:12.834660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:12.842837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2d617d94-8bbe-4f11-af07-5720d97a82dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.148029 Aug 07 12:25:12.843433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 252/484] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:12 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:13.644735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:13.645336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:13.653038 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.653560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.654028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.654727 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.655251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.655681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.662858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:13.664140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:13.670980 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.673216 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.673677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.674413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.674877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.675342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.841088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:13.849843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:13.851538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:13.862206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-69267220-f095-4038-ab6b-4874eb174ee3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.193830 Aug 07 12:25:13.862206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 253/485] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:13 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:13.862206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:13.862206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:13.865748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.866236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.866670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.867489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.867924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.868348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.931282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:13.938900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2444af08-499a-4e90-b578-a1767526e4c5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1214 microversion: 2.1 time: 0.084467 Aug 07 12:25:13.942525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 254/486] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:13 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:13.944330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:13.945008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:13.955319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:13.956181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.956751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.957264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.958038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:13.958605 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:13.959135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:13.966359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a34506af-9b64-41dd-977b-4de655bbb737 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1502 microversion: 2.1 time: 0.325386 Aug 07 12:25:13.966944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 233/487] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:13 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:14.097622 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:14.106519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9d1af1d5-c98e-4674-a874-017fed84b10b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.165522 Aug 07 12:25:14.107849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 255/488] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:13 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:14.877046 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:14.879909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:14.884774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:14.885267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:14.885766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:14.887294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:14.887899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:14.888329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:14.959670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:14.960301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:14.963496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:14.967274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:14.967762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:14.968200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:14.968895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:14.969399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:14.969769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.041553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.078239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ed18355b-8d2b-4e73-9c1b-85d9bf56b8aa tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1270 microversion: 2.1 time: 0.122370 Aug 07 12:25:15.078793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 256/489] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:14 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:15.085248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:15.086069 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:15.093864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:15.094338 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:15.094769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.095510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:15.096566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:15.097597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.128087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.141643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.143404 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.145031 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-01a272e1-ddcf-43b2-bf07-aa5991747311 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.271942 Aug 07 12:25:15.145736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 234/490] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:14 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:15.153719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:15.156436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:15.188635 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:15.190401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:15.192778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.195437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:15.195986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.196816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:15.197417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.208175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c888d4f2-4017-4282-95a5-515b539ea826 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1460 microversion: 2.1 time: 0.127521 Aug 07 12:25:15.208771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 257/491] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:15 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1460 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:15.216712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3b323d3-b3f8-429c-9148-0faf9cdfba5d", "name": "network-vif-deleted", "tag": "4fa27418-a9ea-40a6-a08c-7b7e8dad195e"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:15.239029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:15.239698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:15.240301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:15.264026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] Creating event network-vif-deleted:4fa27418-a9ea-40a6-a08c-7b7e8dad195e for instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d on hv-cinder-84984 Aug 07 12:25:15.269451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-e3610d05-ab35-4541-8fe9-2a9a2853effa req-9d7abacf-f37a-425e-a7e1-ccf77fb1cbbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059558 Aug 07 12:25:15.270347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 258/492] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:15.345696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2ccd1540-43a6-4735-bfd2-b1f56ba572a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: .version_select at 0x7f77a492d160>, body: {"keypair": {"name": "tempest-keypair-530513724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj7mSpVzmzVcSIdAmzBN3CqguMsnCPtV7whB4DEU5jrasIjNGtW/AA2D4oHITSZy1khVa2V55yoONsXOdDZlk0TqqGL6x+qDU0d6LsKpQznU1z8ISbk99x3mTiVCVa1Tg=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:15.366120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-2ccd1540-43a6-4735-bfd2-b1f56ba572a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:25:15.371312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-2ccd1540-43a6-4735-bfd2-b1f56ba572a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:25:15.504913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2ccd1540-43a6-4735-bfd2-b1f56ba572a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163641 Aug 07 12:25:15.505952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 259/493] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:25:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:15.522598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:15.536863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9bd2bedd-1bb2-416a-86ed-ee32fba2dde5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.385810 Aug 07 12:25:15.539799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 235/494] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:15 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:16.100398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:16.101966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:16.114587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.115610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.119053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.122175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.134662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.135298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.177657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:16.178711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:16.190531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.191049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.191487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.192267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.192720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.193144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.249728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.257916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bcccbd51-bd43-4cea-ac76-e5a59cde3d28 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.162136 Aug 07 12:25:16.273641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 260/495] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:16 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:16.273641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:16.273641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:16.273641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.273641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.274149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.274149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.274149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.274149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.344182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.352426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2027bfc2-6103-48f6-9edf-51d93bbd8900 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.092806 Aug 07 12:25:16.353159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 261/496] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:16 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:16.447415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.489619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.489619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.489619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ff599f31-8b5f-4b09-9962-47ac102328d1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.291218 Aug 07 12:25:16.490266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 236/497] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:16 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:16.561698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:16.562329 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:16.569104 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.569755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.570278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.570985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:16.572141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:16.572580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:16.754539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:16.761615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:16.768635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8c9b23a1-734c-4458-9b36-2a49637c561f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.212193 Aug 07 12:25:16.769647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 262/498] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:16 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:17.281324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:17.281921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:17.283892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:17.289466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.289953 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.290438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.291128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.291701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.292649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.378332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:17.378932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:17.390629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.391337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.392093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.393078 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.393689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.394212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.398256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:17.414879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-89d30190-cedd-4182-9b5d-9d1539a884cf tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.137519 Aug 07 12:25:17.431060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 237/499] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:17 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:17.472070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:17.479462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a1e1a451-f016-41cf-9a98-e8fb06644a60 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.105708 Aug 07 12:25:17.480879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 263/500] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:17 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:17.501726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:17.502814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:17.511687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.512689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.513363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.514366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.515267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.515899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.751418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:17.761018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:17.762538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:17.763891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-887989a0-d840-46f8-b4c6-422698bde2d3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.265976 Aug 07 12:25:17.765269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 238/501] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:17 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:17.789698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:17.790285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:17.806972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.819773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.820225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:17.820980 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:17.821433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:17.821858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.004926 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:18.014311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-00dfb829-a4c7-467f-9e54-6e9cb3af5718 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.228497 Aug 07 12:25:18.016201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 264/502] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:17 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:18.441853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:18.443157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:18.451303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.457268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.457268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.457268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.457268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.457817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.501549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:18.509272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:18.509272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.509272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.509659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.510354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.510806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.511927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.540635 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:18.548978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8e5ee5a1-bb73-4e39-9e5e-f9c2a96e6e55 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.110875 Aug 07 12:25:18.550315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 239/503] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:18 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:18.596161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:18.602541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9e1a1e54-fb3c-42be-a66f-fdd26b4392d9 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.104934 Aug 07 12:25:18.611742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 265/504] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:18 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:18.717639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1798376689", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d3266-c358-4a1b-818a-9b2ef5a91e93"}], "security_groups": [{"name": "tempest-securitygroup--1318276922"}], "key_name": "tempest-keypair-530513724", "user_data": "}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:18.797295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:18.798021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:18.804577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.805066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.805710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.806961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:18.807467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:18.807958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:18.835068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:18.875977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] validate_networks() for [('722d3266-c358-4a1b-818a-9b2ef5a91e93', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:25:19.005178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.021960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.024030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.026116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-81a9159e-462f-4b07-bc15-726549f78e81 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.233118 Aug 07 12:25:19.037172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 266/505] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:18 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:19.048074 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:19.048974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:19.055109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.055599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.056040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.056742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.057199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.057628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.235487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.244890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b7b84aed-cfe3-425b-b909-ef4ac9d921b2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.206100 Aug 07 12:25:19.250593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 267/506] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:19 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:19.389219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:25:19.389914 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:25:19.390383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:25:19.390787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:25:19.391220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:25:19.393512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:19.401363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.405795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.405795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.405795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.405795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.406163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.424412 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:25:19.438008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:25:19.452011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:25:19.456867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:25:19.570147 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:19.571624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:19.579678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.580568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.581119 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.581913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.582581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.583129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.594304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d17bb5c9-f9dc-415c-a36b-10a9c24af039 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.882689 Aug 07 12:25:19.595548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 240/507] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:25:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:25:19.612242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-da891ba2-fa2d-4910-bb3f-3629ca3c015c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:19.612945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-da891ba2-fa2d-4910-bb3f-3629ca3c015c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:19.680575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.692846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12a83673-6079-4ae6-98e5-26625a60e7f6 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.126812 Aug 07 12:25:19.703746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 268/508] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:19 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:19.705374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-da891ba2-fa2d-4910-bb3f-3629ca3c015c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.712744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-da891ba2-fa2d-4910-bb3f-3629ca3c015c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1241 microversion: 2.1 time: 0.106961 Aug 07 12:25:19.712915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:19.715198 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:19.715307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 241/509] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:19 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:19.727428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.728021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.728535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.729326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:19.730831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:19.734527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:19.811205 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:19.819343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f3fb6c67-3ba0-4aef-9dde-604898351127 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.114352 Aug 07 12:25:19.819965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 269/510] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:19 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:20.054007 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:20.054693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:20.064869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.065690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.066467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.067585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.068803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.070617 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.233429 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.237176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:20.243234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.244940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.246408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9b554bbb-501c-441d-9711-2c350dcee665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.196361 Aug 07 12:25:20.247251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 242/511] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:20 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:20.267123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:20.267667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:20.273963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.274448 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.274880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.275634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.276155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.277222 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.454764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.462495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d6cd9d35-adb1-4a61-be07-a0f790fb28cd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.199787 Aug 07 12:25:20.463085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 270/512] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:20 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:20.717339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:20.718712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:20.726482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.736662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2ae5b6da-73b4-4503-964d-1b042f76795a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:20.737946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2ae5b6da-73b4-4503-964d-1b042f76795a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:20.756651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.757600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.758540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.760579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.761451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.842932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ae5b6da-73b4-4503-964d-1b042f76795a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.861363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2ae5b6da-73b4-4503-964d-1b042f76795a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1241 microversion: 2.1 time: 0.125921 Aug 07 12:25:20.862332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 271/513] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:20 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:20.876881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.880435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:20.888834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:20.889002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-72fa139d-cfd3-4554-8222-6b6c92712d45 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.172364 Aug 07 12:25:20.889002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 243/514] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:20 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:20.889741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.890323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.890873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.891909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:20.892446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:20.893973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:20.965893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:20.973983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-71a2f130-d3d6-47cd-8357-5b788e5129de tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.097441 Aug 07 12:25:20.977150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 272/515] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:20 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:21.270340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:21.270877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:21.283417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.283912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.284478 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.285288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.285743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.286329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.432523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:21.441883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:21.443419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:21.444617 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ca25d0b8-bf80-4171-a6b8-af7798c858b8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.178507 Aug 07 12:25:21.445417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 244/516] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:21 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:21.485548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:21.486161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:21.492207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.492814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.493252 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.493954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.494560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.494933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.640185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:21.648371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-92d4b365-4052-494f-b9da-b737482d1d0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.168332 Aug 07 12:25:21.648984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 273/517] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:21 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:21.917802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:21.917802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:21.917802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.917802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.918936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.918936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.918936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.918936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.919529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:21.919529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:21.919529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.919529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.920178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.920178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:21.920178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:21.920633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:21.976695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:21.988937 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b3c2e87a-8062-4100-a65a-ed76cf2ce36f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1245 microversion: 2.1 time: 0.109301 Aug 07 12:25:21.993100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 245/518] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:21 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:21.999278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:22.000492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:22.007984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.017869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.018664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.019257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7430dfab-5b42-4043-aee0-9eaa07b9184c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.113935 Aug 07 12:25:22.019451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.020181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 274/519] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:21 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:22.020994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.021810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.022565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.098828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.107484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-45d87420-7a04-4869-b1c1-cf93d89f5f5e tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.115116 Aug 07 12:25:22.108299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 246/520] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:21 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:22.470076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:22.470691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:22.476872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.477502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.477964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.478641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.479122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.480062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.619306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.628739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.630295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.631503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f5543501-d272-4937-9a4b-ac4112737f6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.165686 Aug 07 12:25:22.632389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 275/521] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:22 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:22.670483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:22.671033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:22.677287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.677767 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.678201 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.678890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:22.679364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:22.679895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:22.822674 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:22.830968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6c6196a7-2d3f-434d-a205-5f5f819608ea tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.165109 Aug 07 12:25:22.831757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 247/522] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:22 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:23.010431 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:23.011196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:23.017826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.018438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.019106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.020117 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.020639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.021166 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.041246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:23.042760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:23.048869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.049466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.050033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.050789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.051341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.051834 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.087752 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.096257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-80210084-385d-414c-b831-69a24f961a8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1245 microversion: 2.1 time: 0.089694 Aug 07 12:25:23.097170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 276/523] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:23 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:23.119755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.127890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bd83d256-4266-4571-b42d-bcc317af3b58 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1278 microversion: 2.1 time: 0.091331 Aug 07 12:25:23.128474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 248/524] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:23 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:23.129063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:23.129719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:23.138315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.138315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.138315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.138315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.138767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.139113 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.205710 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.213771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f5ebf51c-20af-4af4-9310-ceee99471c29 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1298 microversion: 2.1 time: 0.088576 Aug 07 12:25:23.215012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 277/525] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:23 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:23.655978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:23.656585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:23.662559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.663067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.663510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.664204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.664680 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.665110 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.852383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:23.852920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:23.859481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.861760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.861760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.861760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:23.861760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:23.862145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:23.897887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.906558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.908129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:23.912573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b75a9fc3-43b9-4f37-9cb0-64e4be509a6b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.257447 Aug 07 12:25:23.912573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 249/526] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:23 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:23.993708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:24.001719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9248b67a-3ae8-41b6-b86c-d680374175bb tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.153429 Aug 07 12:25:24.002291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 278/527] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:23 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:24.117611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:24.118216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:24.125194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.125672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.126100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.126778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.127261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.127681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.148399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:24.149015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:24.155186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.155674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.156108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.156804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.157251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.157674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.196351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:24.197037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ae67b8a4-cdf0-4bba-b1d2-cbb057bf03dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1245 microversion: 2.1 time: 0.083251 Aug 07 12:25:24.197607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 250/528] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:24 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:24.220199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:24.227694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-879de63c-5adb-4df5-b7bb-a6ecbd2a0d1a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1288 microversion: 2.1 time: 0.083205 Aug 07 12:25:24.228268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 279/529] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:24 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:24.236001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:24.236606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:24.242579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.243079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.243509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.244179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.244623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.245037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.279537 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.280012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.280716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.281400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lazy-loading 'fault' on Instance uuid d3b323d3-b3f8-429c-9148-0faf9cdfba5d {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:25:24.345035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:24.352827 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9023345c-986e-4598-ab7e-67bbb68d3eb8 tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1303 microversion: 2.1 time: 0.120571 Aug 07 12:25:24.358439 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 251/530] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:24 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:24.932832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:24.933485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:24.939390 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.939885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.940323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:24.941016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:24.941469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:24.941899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.021901 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:25.022513 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:25.028716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.029205 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.029642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.030340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.030791 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.031243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.078415 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.086624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.088258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.090066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8159fd0e-345a-43cb-82fd-fc41ccc03ec6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.161200 Aug 07 12:25:25.090719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 280/531] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:24 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:25.217718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:25.218395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:25.226148 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.226703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.227244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.234665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.234665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.234665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.267168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.274832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-771d3c99-8ff0-4999-ab97-d0bbd849e0ec tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.256754 Aug 07 12:25:25.275526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 252/532] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:25 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:25.280325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:25.281241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:25.287191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.287745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.288251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.288970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.289427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.289848 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.295287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.302948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-284018ee-3094-4d07-922e-ca148b725c0a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1237 microversion: 2.1 time: 0.089143 Aug 07 12:25:25.303736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 281/533] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:25 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:25.375306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:25.376114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:25.382239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.382712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.383207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.383894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.384337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.384825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.415961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:25.416440 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:25.416869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:25.417948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lazy-loading 'fault' on Instance uuid d3b323d3-b3f8-429c-9148-0faf9cdfba5d {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:25:25.426709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.435477 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f532d4b0-1228-438b-83a8-3b2980079ef1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.158780 Aug 07 12:25:25.447794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 253/534] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:25 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:25.464607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '522765afd64c4018baebae36facfc3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e6b27298e34383acb124fd4fc56918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:25.472125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-87ab0b5f-91a5-40ed-9f2c-e85909ab7cbc tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 200 len: 1303 microversion: 2.1 time: 0.100826 Aug 07 12:25:25.472694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 282/535] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:25 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:26.113367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:26.113976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:26.120304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.120945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.121387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.122084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.122532 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.123185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.259684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f315bf98-44f1-40ea-b836-e2f1baf91992", "tag": "fb0190cb-1c3c-42a2-b345-0c2dafeb090d"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:26.270505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.270896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.271353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.284331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] Creating event network-changed:fb0190cb-1c3c-42a2-b345-0c2dafeb090d for instance f315bf98-44f1-40ea-b836-e2f1baf91992 on hv-cinder-84984 Aug 07 12:25:26.289225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-19befaea-9a2b-4e2e-ae07-0b3d41294d1b req-352f5b8d-a4b6-4b0a-b8e1-649d07c4c77f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033939 Aug 07 12:25:26.290162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 283/536] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:25:26.295125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.297422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:26.298597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:26.304241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.304545 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.305525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.305751 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.306023 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.306396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.306848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.307229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fa621c7e-672d-475e-a23a-e645e765f0db tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.198045 Aug 07 12:25:26.319268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.319540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 254/537] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:26 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:26.325786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:26.329179 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:26.336024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:26.343290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.343811 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.344306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.345010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.345509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.346068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.432280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.441172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-233ec422-42dc-42ed-a0f1-c6ed78ba8438 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1293 microversion: 2.1 time: 0.120426 Aug 07 12:25:26.451287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 255/538] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:26 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:26.455757 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.460785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:26.461932 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:26.464657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2f3afe1b-1ca2-4262-9c76-4df05abd1455 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.171830 Aug 07 12:25:26.465528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 284/539] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:26 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:26.470101 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.470810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.473325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.473325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.473325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.473325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.493200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:26.493820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] [instance: d3b323d3-b3f8-429c-9148-0faf9cdfba5d] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:26.500288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.501876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.501876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.501876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:26.502332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:26.502787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:26.517197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] HTTP exception thrown: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Request method failure captured: Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d HTTP/1.1 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi767TyVwmEOFfk1xChevkwk9fecQvVKpf1J1nreJNcDh-XYxHJ9KIsMTahiVNcksMuYbD2XOKjkDU7cl3OVpDrdYSHheKk-SrDFtaQrndIo2uEYWhbj4Rgo7teK5ml460E8c1xVXjcygsDh3Cr6V9NuFixUJaOCyNOfo9EdTuzhCfYYo Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 74e6b27298e34383acb124fd4fc56918 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesActionsTest-1466826304 Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:25:26.519035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_74e6b27298e34383acb124fd4fc56918", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/74e6b27298e34383acb124fd4fc56918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesActionsTest-1466826304 Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 74e6b27298e34383acb124fd4fc56918 Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesActionsTest-1466826304 Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesActionsTest-1466826304-project Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 522765afd64c4018baebae36facfc3f3 Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesActionsTest-1466826304-project Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. Aug 07 12:25:26.520406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'd3b323d3-b3f8-429c-9148-0faf9cdfba5d'} Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:25:26.521379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. Aug 07 12:25:26.522691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:25:26.523849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] Returning 404 to user: Instance d3b323d3-b3f8-429c-9148-0faf9cdfba5d could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:25:26.523849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0cb6a94a-8cef-4899-b30b-71851e00aabd tempest-VolumesActionsTest-1466826304 tempest-VolumesActionsTest-1466826304-project] 10.222.0.30 "GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d" status: 404 len: 111 microversion: 2.1 time: 0.031503 Aug 07 12:25:26.525889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 285/540] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:26 2022] GET /compute/v2.1/servers/d3b323d3-b3f8-429c-9148-0faf9cdfba5d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:25:26.846235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:26.853581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5f3b54bc-c2a5-4ae7-b8ba-77ce644397b9 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.396905 Aug 07 12:25:26.854139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 256/541] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:26 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:27.331837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:27.332537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:27.339871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.340510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.342123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.342123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.342123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.342528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.465683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:27.467147 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:27.484572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.485454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.486108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.487571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.488243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.488856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.509766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:27.520026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:27.521671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:27.522836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-569ee4e2-71a9-40be-b864-ce5f9a04d8a8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.194872 Aug 07 12:25:27.523766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 286/542] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:27 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:27.542348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:27.542962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:27.552132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.552726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.553187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.553947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.554605 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.555257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.625254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:27.639140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-43db7b93-6031-4570-b9de-1d79726dc683 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1299 microversion: 2.1 time: 0.179461 Aug 07 12:25:27.654383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 257/543] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:27 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1299 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:27.703200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:27.712500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d3549c6f-a02b-4982-a656-c74086936c99 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.186943 Aug 07 12:25:27.713685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 287/544] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:27 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:27.878818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:27.880076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:27.891292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.892280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.892973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:27.894030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:27.894747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:27.895379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.084870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.093030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a0aa75d5-eb5b-4fe5-a7b2-b110eafb551b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.221820 Aug 07 12:25:28.093600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 258/545] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:27 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:28.550989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:28.551611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:28.557548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.558024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.558535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.559244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.559694 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.560119 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.661674 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:28.662276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:28.669055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.669535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.669974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.670660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.671132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.671551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.675496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:28.691770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.696771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.698821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.700035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-88139816-3bad-4a19-b7d7-826a88123eb7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.152992 Aug 07 12:25:28.700596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 288/546] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:28 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:28.733924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:28.734528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:28.740419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.740872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.741306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.741989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:28.742434 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:28.742852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:28.801188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.808829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fc414a16-ae0d-4af1-89d6-efbc719a4e54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.150996 Aug 07 12:25:28.809399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 259/547] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:28 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:28.874819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:28.882204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-62a9a838-e8d5-4d28-9687-97c5a4da3019 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.152319 Aug 07 12:25:28.882770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 289/548] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:28 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:29.115417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:29.116058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:29.122395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.122882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.123346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.124043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.124500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.124922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.255278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:29.263138 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6d028719-4cf6-4e3d-bce8-81cab4a18991 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.151537 Aug 07 12:25:29.263703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 260/549] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:29 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:29.724046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:29.724656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:29.730531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.731030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.731465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.732143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.732599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.733004 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.829611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:29.830310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:29.832248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:29.833449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=8 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:29.838013 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.838492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.839535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.840408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.840858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.841278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.865109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:29.873842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:29.875390 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:29.876560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8c15a255-ab89-48d7-8039-663ce60243a7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.156405 Aug 07 12:25:29.877116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 290/550] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:29 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:29.903665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:29.904322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:29.910393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.910885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.911358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.912057 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:29.912516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:29.912945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:29.974050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:29.982246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0916b020-d334-4517-9298-437ce4cb20ac tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.156444 Aug 07 12:25:29.982811 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 261/551] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:29 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:30.042938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:30.050355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-436c40f5-74dd-4f7e-97a4-f6df5ad51e2b tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.151369 Aug 07 12:25:30.050920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 291/552] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:29 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:30.283742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:30.284437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:30.290298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:30.290950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:30.291415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:30.292612 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:30.293061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:30.293480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:30.420551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:30.427875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8cae5167-58c6-4d1f-89a0-c73e671bad7a tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.148069 Aug 07 12:25:30.428431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 262/553] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:30 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:30.899615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:30.900227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:30.902682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=12 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:30.907426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:30.907910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:30.908343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:30.909029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:30.909482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:30.909908 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.001684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:31.002435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:31.008927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.011261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.011743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.012593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.013049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.013473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.042021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.050984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.052561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.053739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-991d5878-8cfc-465e-8a6d-1bedd4619dc7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.158039 Aug 07 12:25:31.054493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 292/554] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:30 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:31.071360 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:31.072002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:31.078766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.079281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.079717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.080407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.080860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.081284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.147834 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.156024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-224880fb-6998-4495-a4ae-52c214e97c67 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.158073 Aug 07 12:25:31.156531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 263/555] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:30 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:31.210009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.217744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cc82bd96-f0cd-4d28-a76e-918d2f2c64c3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.150354 Aug 07 12:25:31.218314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 293/556] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:31 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:31.448582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:31.449096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:31.454923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.455430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.455861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.456538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.456981 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.457426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.585418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:31.592877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c190363e-2cce-47e3-9293-ec5aa0669712 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.148321 Aug 07 12:25:31.593445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 264/557] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:31 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:31.901051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "name": "network-vif-plugged", "status": "completed", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:31.911137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:31.911722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:31.912176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:31.924780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] Creating event network-vif-plugged:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:25:31.929650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-d3efe960-6da3-4f26-95ce-dc07d18b2022 req-7b0643dd-80e3-4c91-88e9-19cc2fbc6cd0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032344 Aug 07 12:25:31.930223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 294/558] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:32.083689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:32.083689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:32.084538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.085044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.085475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.086171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.086621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.087067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.177062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:32.178254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:32.184728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.185218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.185658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.186357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.186890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.187383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.325070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.332807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b8ab3b94-899a-49b4-a578-d985b02ae7c7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.160004 Aug 07 12:25:32.333430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 295/559] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:32 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:32.338002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:32.338618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:32.345063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.345556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.346007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.346708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.347193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.347623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.499112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.507126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c86476f4-84ae-4133-9e7b-d4ffa8f5306e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.172655 Aug 07 12:25:32.509485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 296/560] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:32 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:32.579430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.590771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.592419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.594103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dc738d69-43c5-4af1-b881-208ecb55f697 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.520866 Aug 07 12:25:32.609977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 265/561] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:32 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:32.621024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:32.622067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:32.637308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.643153 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.643707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.644866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:32.649058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:32.649786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:32.816306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:32.825084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7988103f-4fdb-4eec-8000-2f1603de4d77 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.214652 Aug 07 12:25:32.825720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 297/562] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:32 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:33.354578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:33.355443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:33.362058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.362473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.363183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.364065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.364682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.365380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.473101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d749f04-654d-4f11-8827-2849cd637994", "tag": "eed64b0a-cc21-4240-b190-0a8deaf90077"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:33.495507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.503050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.503914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.524493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] Creating event network-changed:eed64b0a-cc21-4240-b190-0a8deaf90077 for instance 7d749f04-654d-4f11-8827-2849cd637994 on hv-cinder-84984 Aug 07 12:25:33.550493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-87636ebb-8190-44c9-abce-71bc84cd76ac req-1bd78b77-2357-4481-9611-df76e464ab66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080968 Aug 07 12:25:33.553692 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 298/563] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:33.563584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:33.565238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:33.576913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:33.580239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.581492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.582368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.583992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.585169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.594618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.755456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:33.763268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:33.772843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d3ad9703-45c0-4035-8a15-43455b0f1bb2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.217642 Aug 07 12:25:33.773917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 299/564] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:33 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:33.780376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:33.781303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:33.784087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cacf42fb-64d6-4939-98e4-552ea77cbb7c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.433450 Aug 07 12:25:33.801190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.801190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.801190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.801190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.801749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.801749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.801935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 266/565] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:33 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:33.850363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:33.851306 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:33.864045 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.865072 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.867331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.868966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:33.871607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:33.872990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:33.949789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:33.961690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:33.961924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:33.963559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fe4180dd-0f13-449c-a6df-7e3f453b68bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.188372 Aug 07 12:25:33.995953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 300/566] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:33 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:34.137127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:34.148973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-852f1572-e9e1-44d4-8cca-38da245b4da2 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.306205 Aug 07 12:25:34.150540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 267/567] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:33 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:34.795723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:34.796461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:34.805885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:34.807224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:34.808327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:34.808651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:34.808945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:34.810150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:34.810668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:34.811093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:34.819592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:34.820426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:34.821083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:34.822009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:34.822854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:34.823588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:34.991301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.004183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e18eae45-d4a4-486e-a52b-17a44230e4f4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1359 microversion: 2.1 time: 0.211505 Aug 07 12:25:35.017787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 301/568] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:34 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:35.017787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:35.017787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:35.024355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:35.024853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:35.025317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:35.027213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:35.027680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:35.028114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:35.056647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.071967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f22aa3d5-a1ef-4035-ae98-0945ed23fbb1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.270662 Aug 07 12:25:35.077187 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 268/569] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:34 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:35.171719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:35.173562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:35.192514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:35.192514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:35.192514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:35.192514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:35.193756 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:35.201647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:35.263358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.275962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.279406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.280969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8fa2e873-b8a3-4369-9369-7ee7f5f8f9c2 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.273802 Aug 07 12:25:35.281946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 302/570] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:35 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:35.398828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:35.412639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6f543698-c271-40e9-98fb-234cb7f43bfb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.246391 Aug 07 12:25:35.413669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 269/571] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:35 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:36.027343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.028815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.035766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.042044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.042044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.042044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.042044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.042393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.043678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:36.106732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.108346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.123218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.124231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.124928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.125909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.126861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.127499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.242664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.253404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7547795c-d2db-4394-bb88-184ed9c4b242 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1548 microversion: 2.1 time: 0.230820 Aug 07 12:25:36.254242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 303/572] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:36.287406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.288337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.297771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.298493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.302858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.302858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.302858 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.303976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.328368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.339632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1ed16076-dd09-4b8f-8f48-dde2bb88858e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.243455 Aug 07 12:25:36.353747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 270/573] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:36.362409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.363327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.382455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.383156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.383784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.384596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.385154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.386436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.513640 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.522706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1207cf29-3dbe-4070-8fe6-77f70f4cef33 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1548 microversion: 2.1 time: 0.241286 Aug 07 12:25:36.523604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 304/574] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:36.528427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.529299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.535265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.535822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.536336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.537103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.537707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.538174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.562672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.571232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.572881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.574730 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f84317d7-af0e-41be-afcc-6f53d64bc3fd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.219713 Aug 07 12:25:36.575321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 271/575] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:36.579909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.585084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.585618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Searching by: {'deleted': False, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc'} {{(pid=118243) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 07 12:25:36.592395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.592874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.593305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.594024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.594468 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.594889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.692914 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.multi_cell_list [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118243) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 07 12:25:36.701014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:36.710889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0781b647-332d-4c31-943a-aa712bfb9640 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.186018 Aug 07 12:25:36.714606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 305/576] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:36.726353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32da9997-8a3b-4483-ac40-2d906b6bc2e6"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:36.728901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.736229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.736725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.737234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.737945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.738406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.738835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.844439 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e37f2ff7-dc2d-4426-abff-01c015b34824 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.267546 Aug 07 12:25:36.851925 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 272/577] 10.222.0.30 () {58 vars in 1125 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers => generated 343 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:36.860274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:36.861350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:36.868001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.868711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.869252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:36.870210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:36.871050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:36.871580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.049809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:37.064336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c4730659-466e-435b-90f1-84a0e999f42a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1548 microversion: 2.1 time: 0.208017 Aug 07 12:25:37.071419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 273/578] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:36 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1548 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:37.365183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:37.366531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:37.378445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.379029 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.379526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.394909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.397563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.409599 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.627190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:37.635530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-58bd00f7-b9d2-43bd-aaae-15907aa0a454 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.278386 Aug 07 12:25:37.636253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 274/579] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:37 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:37.647833 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f315bf98-44f1-40ea-b836-e2f1baf91992", "name": "network-vif-plugged", "status": "completed", "tag": "fb0190cb-1c3c-42a2-b345-0c2dafeb090d"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:37.657199 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.657940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.658526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.671245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] Creating event network-vif-plugged:fb0190cb-1c3c-42a2-b345-0c2dafeb090d for instance f315bf98-44f1-40ea-b836-e2f1baf91992 on hv-cinder-84984 Aug 07 12:25:37.676496 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-1eaeb2d1-32cd-4908-96b6-3ac04e2eec1b req-8848008e-9190-4cde-966e-77f9506fa974 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032158 Aug 07 12:25:37.677197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 275/580] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:37.682254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:37.684089 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:37.690743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.698853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.698853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.698853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.698853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.699454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.699454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:37.886525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:37.896776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:37.898454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:37.900081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-69187c53-60f4-49f6-971a-98e03511a002 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.221817 Aug 07 12:25:37.900877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 276/581] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:37 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:37.925988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:37.925988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:37.940278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.940874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.941379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:37.943911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:37.944514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:37.945017 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:38.148264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:38.158662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ad15a312-1ce1-4f68-9844-da073bcd3b3e tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.245054 Aug 07 12:25:38.159831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 277/582] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:37 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:38.656606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:38.657365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:38.664161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:38.664836 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:38.665276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:38.666002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:38.666456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:38.666888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:38.712544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b0b10be3-d8d9-4693-a851-09dd1c022f5f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.994219 Aug 07 12:25:38.720232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 306/583] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:25:36 2022] POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments => generated 194 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:38.831693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:38.841471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-95bb37cd-8092-4cbe-9832-8f77b7a4356d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.188613 Aug 07 12:25:38.855025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 278/584] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:38 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:38.942487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:38.943404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:38.950826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:38.961808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:38.962469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:38.963233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:38.963865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:38.964139 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.184789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:39.185311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:39.194784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.196643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.197083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.197826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.198659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.199274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.237346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:39.247214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:39.248703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:39.250291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3c1ce67c-02d1-4270-92ae-a65d49f6e530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.328223 Aug 07 12:25:39.252406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 307/585] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:38 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:39.336447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e832a77a-837d-4fd3-8bae-1e7e887a9dc7"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:39.336447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:39.343236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.343872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.344415 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.356075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.357845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.363036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.393833 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:39.403174 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-07f59d3f-61c2-4cf0-859a-cde95a7e3ff5 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1318 microversion: 2.1 time: 0.225166 Aug 07 12:25:39.416067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 279/586] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:39 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:39.697961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "name": "network-vif-plugged", "status": "completed", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:39.708445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.709002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.709487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.723379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] Creating event network-vif-plugged:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:25:39.730040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-5a8eb71b-87e0-4355-bcb3-5d457625ad10 req-926ec795-392b-4b37-9c51-562b442750c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Aug 07 12:25:39.730854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 280/587] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:25:39.864052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:39.864745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:39.885754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.886529 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.886972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:39.887700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:39.888352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:39.888963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.036570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:40.044936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-12519a4f-f427-4ae4-bade-c595a95e4e75 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.185083 Aug 07 12:25:40.045514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 281/588] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:39 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:40.286467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:40.287682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:40.294207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:40.296081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.296762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.297356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.298298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.298899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.299509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.382936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-17ce007c-c4dd-4703-b4aa-883b5b9925e6 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054060 Aug 07 12:25:40.384199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 308/589] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:25:39 2022] POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:40.426018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:40.427129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:40.437668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.439502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.440289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.442274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.442920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.445825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.464731 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:40.474978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:40.478163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:40.480866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1b684c13-8de3-4c88-940c-1e6fc16cc5bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.200613 Aug 07 12:25:40.503386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 282/590] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:40 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:25:40.710774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:40.713857 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e6e8a4ad-2eab-434d-9ff8-e3f135c99082 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1507 microversion: 2.1 time: 0.292637 Aug 07 12:25:40.727382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 309/591] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:40 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:40.735600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e426f707-4127-458d-8d08-cf9f1239532c", "device": "/dev/sdb"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:40.738711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:40.746354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.747196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.747878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:40.748812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:40.749474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:40.750106 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.068550 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:41.069070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:41.076406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:41.076896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:41.077475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.079492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:41.079492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:41.079492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.250204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:41.279066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-53b1b841-e4e1-46ec-9172-a4a9448a8115 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.215367 Aug 07 12:25:41.279879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 310/592] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:41 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:41.506103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:41.508411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:41.520458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:41.521297 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:41.522098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.523390 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:41.523948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:41.524659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.710274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:41.724012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:41.727614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:41.728805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-471d0ba6-342a-4899-9d40-230238e188ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.226995 Aug 07 12:25:41.729893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 311/593] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:41 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:41.757039 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d749f04-654d-4f11-8827-2849cd637994", "name": "network-vif-plugged", "status": "completed", "tag": "eed64b0a-cc21-4240-b190-0a8deaf90077"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:41.774572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:41.775582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:41.776907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:41.790189 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] Creating event network-vif-plugged:eed64b0a-cc21-4240-b190-0a8deaf90077 for instance 7d749f04-654d-4f11-8827-2849cd637994 on hv-cinder-84984 Aug 07 12:25:41.795865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-e3a10080-d2de-4fa5-9c2d-974985b8954d req-a282e101-efb8-4dde-829c-a8d3dc21bebb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Aug 07 12:25:41.796706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 312/594] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:41.935907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-84dfc907-b0ab-42d4-9cd9-76183aafafd8 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "POST /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203701 Aug 07 12:25:41.936693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 283/595] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:25:40 2022] POST /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:42.304033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:42.304931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:42.312665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:42.313635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:42.314173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:42.315173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:42.315848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:42.316588 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:42.529775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:42.529775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e338594c-3161-4507-8abe-b6b1a214825a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.228086 Aug 07 12:25:42.529775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 313/596] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:42 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:25:42.754195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:42.758375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:42.764331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:42.772005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:42.772005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:42.772005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:42.772005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:42.772393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:42.898319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:42.906707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:42.908225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:42.909364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ca58f374-edec-44ce-861b-63855c71d881 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.161183 Aug 07 12:25:42.909920 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 284/597] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:42 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:43.554002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:43.554980 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:43.561547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:43.562033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:43.562374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:43.563120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:43.564852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:43.565447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:43.745773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:43.759184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0c6653be-4976-4c95-9c62-9a1cefc614e8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.208400 Aug 07 12:25:43.763092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 314/598] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:43 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:43.933266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:43.933831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:43.940427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:43.940988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:43.941424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:43.942104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:43.942735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:43.943372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:44.117994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:44.135065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:44.141553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:44.145696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d18c479f-f455-463d-b7f2-902ed62124cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.217125 Aug 07 12:25:44.163049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 285/599] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:43 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:44.781251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:44.782072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:44.789647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:44.790263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:44.790857 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:44.791933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:44.793344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:44.794246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:44.961658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:44.970987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c5f8ac18-ae43-4fb9-86ad-24a4a75c269d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1367 microversion: 2.1 time: 0.194103 Aug 07 12:25:44.971630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 315/600] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:44 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:45.177769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:45.179810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:45.195678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:45.196638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:45.198648 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:45.210432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:45.211578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:45.212462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:45.421739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:45.439034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:45.440635 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:45.443222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-844c0238-bc74-4ea3-9149-fd102904ddf4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1808 microversion: 2.20 time: 0.272875 Aug 07 12:25:45.444313 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 286/601] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:45 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:45.994108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:45.994764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:46.001581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.004836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.004836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.004836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.004836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.005241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.158188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:46.167302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a526a5da-7138-4461-bbf6-0a950acccb8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1557 microversion: 2.1 time: 0.176624 Aug 07 12:25:46.168196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 316/602] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:45 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:46.188092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:46.193649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:46.196172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.196655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.197092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.197820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.198793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.199250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.288136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-733ee8b9-69fe-4649-9143-b88c77683f43 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103463 Aug 07 12:25:46.288821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 287/603] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:25:46 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:46.475373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:46.476910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:46.485373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.491263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.492010 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.493165 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:46.493990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:46.496060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:46.675294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:46.679519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:46.687547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:46.703152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:46.703152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ee9c589e-0091-45af-9823-7f89f6e7b6cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1795 microversion: 2.20 time: 0.221431 Aug 07 12:25:46.704581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 317/604] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:25:46 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1795 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:25:47.607122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d749f04-654d-4f11-8827-2849cd637994", "tag": "eed64b0a-cc21-4240-b190-0a8deaf90077"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:47.621056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:47.627200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:47.627200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:47.627788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:47.647980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] Creating event network-changed:eed64b0a-cc21-4240-b190-0a8deaf90077 for instance 7d749f04-654d-4f11-8827-2849cd637994 on hv-cinder-84984 Aug 07 12:25:47.657864 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-77245f9a-70d8-4845-a3da-affb9aaf4fef req-c8cf1ac4-3d17-441a-95f7-c7e83381bce0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055806 Aug 07 12:25:47.659724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 288/605] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:48.779894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:48.783082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:48.798869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:48.802722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:48.802722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:48.802722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:48.802722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:48.803164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:48.831773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'flavor' on Instance uuid 8286be07-d68e-431d-9e39-fdc088ca2ec3 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:25:49.221108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7a3a3572-a670-4f5c-9602-567c2f2e2457 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/action" status: 200 len: 32 microversion: 2.1 time: 0.446176 Aug 07 12:25:49.221728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 318/606] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:25:48 2022] POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/action => generated 32 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:25:49.235142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:49.236158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:49.243985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:49.245171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:49.245607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:49.246385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:49.246756 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:49.247491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:49.392944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:49.402808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a952e5a4-90cf-4500-af2f-d99227708456 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.173002 Aug 07 12:25:49.403922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 289/607] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:49 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:50.425530 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:50.426235 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:50.432773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:50.433268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:50.433715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:50.434413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:50.434871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:50.435336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:50.569814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:50.578664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-eacde9e3-6b3b-402c-a5f9-62d915775e56 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.157838 Aug 07 12:25:50.579266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 319/608] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:50 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:51.599789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:51.600400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:51.607779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:51.608260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:51.608695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:51.609380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:51.609838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:51.610254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:51.736042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:51.743856 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fd1cc5f1-d7d0-42a7-b42d-c1fa8f141695 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.147923 Aug 07 12:25:51.745030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 290/609] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:51 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:52.766795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:52.767520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:52.774063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:52.774543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:52.774976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:52.776471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:52.777071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:52.777493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:53.128129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:53.135854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9db109e9-01ec-4436-adf1-352059aba2fa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.372384 Aug 07 12:25:53.136687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 320/610] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:52 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:54.157794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:54.158400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:54.164862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:54.165346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:54.165780 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:54.166623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:54.167125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:54.167553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:54.296885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:54.304963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e894bb11-327a-4340-9108-47ef4694291c tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.151230 Aug 07 12:25:54.305571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 291/611] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:54 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:55.326544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:55.327195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:55.333970 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:55.334465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:55.334905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:55.335711 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:55.336375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:55.336847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:55.475891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:55.484815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e6492735-c562-4ba3-8e2d-bc14730b74aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.163003 Aug 07 12:25:55.488108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 321/612] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:55 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:56.508749 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:56.509378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:56.516643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:56.517126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:56.517577 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:56.518400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:56.518904 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:56.519346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:56.670430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:56.678475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f4db42dc-1c0c-49bf-b70d-149c4fe9aebd tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.173889 Aug 07 12:25:56.688755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 292/613] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:56 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:56.712344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:56.713008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:56.719352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:56.719834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:56.723135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:56.723856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:56.724313 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:56.724738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:56.860890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:56.869567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7d3a6b62-cf76-412d-9a0f-857c8c6adee2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1594 microversion: 2.1 time: 0.160359 Aug 07 12:25:56.870190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 322/614] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:56 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:57.701294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:57.703538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:57.718480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:57.718990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:57.719993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:57.723472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:57.723944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:57.724378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:57.729475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:25:57.882712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:57.891817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-16ccaff4-ea5a-4497-9684-cdfc88be2563 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.194580 Aug 07 12:25:57.892417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 293/615] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:57 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:25:58.917240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:25:58.918163 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:25:58.935083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:58.935083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:58.935083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:58.935083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:58.935469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:58.935469 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:59.073701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:25:59.090325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:25:59.091109 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:25:59.095259 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:25:59.104454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] Creating event network-changed:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:25:59.110437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-306c27ae-39bb-470d-b1e3-d0c173d74ecc req-766e0593-615b-4032-8bd1-af687fd3e127 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041720 Aug 07 12:25:59.113414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 294/616] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:25:59.125132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:25:59.134248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5ba07efb-22df-45f8-9265-00e30c9cd4a1 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.224079 Aug 07 12:25:59.135691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 323/617] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:25:58 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:00.156059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:00.156877 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:00.164497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:00.165065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:00.166226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:00.167227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:00.167692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:00.168140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:00.315526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:00.324792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1903f69b-f9de-484b-8028-76f0ad0c678f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.172080 Aug 07 12:26:00.324792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 295/618] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:00 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:01.344798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:01.345420 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:01.352040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:01.352528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:01.352967 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:01.353812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:01.354273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:01.354713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:01.521120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:01.529844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1417b4c1-74e2-4e8e-a8dd-70a742cd2653 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.188858 Aug 07 12:26:01.530412 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 324/619] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:01 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:01.905135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-251659548"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:01.905705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:01.912579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:01.913059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:01.913491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:01.914172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:01.914628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:01.915074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.037236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.network.security_group_api [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Adding security group f52ab156-6eff-4381-81ad-0cb7d4dc8077 to port 0c677232-63cc-4a24-9def-bf711bd3f6f7 Aug 07 12:26:02.406375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1cdc4f0e-6ff5-4978-b434-309f6abaa5df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action" status: 202 len: 0 microversion: 2.1 time: 0.505162 Aug 07 12:26:02.406990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 296/620] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:26:01 2022] POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:26:02.415475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:02.415670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:02.416583 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:02.422813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:02.423340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:02.423770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.424600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:02.425185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:02.425610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.426595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:02.427086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:02.427513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.438938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] Creating event network-changed:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:26:02.444158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-449ac642-0820-4b47-8eb0-9855efb749e8 req-c9bfb5a9-e7e9-4a25-b46c-7132b1a7efac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032382 Aug 07 12:26:02.444794 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 325/621] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:26:02.551670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:02.552370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:02.559097 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:02.559516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:02.559962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.560658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:02.561112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:02.561538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:02.577961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:02.585987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4456af59-730f-4bd7-a3a4-2be1f27877c2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1640 microversion: 2.1 time: 0.174401 Aug 07 12:26:02.586562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 297/622] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:02 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1640 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:02.691985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:02.700788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-18c85ea9-be45-4f81-83f2-0baa780fb93d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.153437 Aug 07 12:26:02.701355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 326/623] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:02 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:03.721399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:03.722036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:03.728327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:03.728826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:03.729295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:03.729992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:03.730442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:03.730860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:03.895860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:03.904812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7cd4b90b-ba83-4774-a570-6453f2145b98 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.187500 Aug 07 12:26:03.905393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 298/624] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:03 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:04.925332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:04.925946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:04.928414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=55 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:04.933718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:04.934204 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:04.934643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:04.935361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:04.939839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:04.939839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:05.067055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:05.075501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dd6b43aa-ead8-4116-8d7b-88844cfae859 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.154029 Aug 07 12:26:05.076076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 327/625] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:04 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:06.096295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:06.096929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:06.103270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:06.108799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:06.108799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:06.108799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:06.108799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:06.109115 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:06.233965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:06.241886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-184f9766-0cba-4257-abf2-76b17996e5b6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.149388 Aug 07 12:26:06.242454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 299/626] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:06 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:07.263300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:07.263913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:07.270155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:07.270632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:07.271095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:07.271785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:07.272239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:07.272664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:07.404354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:07.412266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-872482ff-867c-4568-b1a6-be8d1e07801d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.153153 Aug 07 12:26:07.412831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 328/627] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:07 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:08.434587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:08.435361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:08.441329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:08.441814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:08.442235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:08.442918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:08.443488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:08.443846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:08.576683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:08.584732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-65eae79e-520d-4851-9fab-01889c458e2f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.154836 Aug 07 12:26:08.585300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 300/628] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:08 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:09.606730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:09.607373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:09.613913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:09.614397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:09.614836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:09.615548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:09.616006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:09.616435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:09.747489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:09.755482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-49966897-8113-4345-9b36-57665b227b54 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.152844 Aug 07 12:26:09.756054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 329/629] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:09 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:10.777310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:10.777910 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:10.780359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=38 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:10.784961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:10.785437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:10.785869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:10.786554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:10.787015 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:10.787438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:10.913286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:10.921201 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9acc178c-396a-4a45-8815-7f564502700b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.148256 Aug 07 12:26:10.921769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 301/630] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:10 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:11.942515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:11.943161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:11.950209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:11.950696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:11.951171 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:11.951886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:11.952344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:11.952771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:12.085231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:12.093788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1bc0d0f6-0f1c-4d88-95da-f6f94f72c82d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.155270 Aug 07 12:26:12.094357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 330/631] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:11 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:13.114490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:13.115168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:13.121705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:13.122279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:13.122785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:13.123513 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:13.123987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:13.124396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:13.259090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:13.267411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-22edb8dd-d821-4e58-982a-1f81b5742bd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.156748 Aug 07 12:26:13.267979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 302/632] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:13 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:14.288996 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:14.289594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:14.296568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:14.297050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:14.297501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:14.298172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:14.298626 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:14.299079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:14.425997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:14.434444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a67527a5-b39b-4387-972f-7748da90237b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.149405 Aug 07 12:26:14.435019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 331/633] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:14 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:15.455863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:15.456453 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:15.462900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:15.463458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:15.463890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:15.464659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:15.465103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:15.465518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:15.596634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:15.604348 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d0466fc8-58be-4534-aae9-ee57df92288a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.152333 Aug 07 12:26:15.605404 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 303/634] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:15 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:16.625723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:16.626331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:16.632806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:16.633282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:16.633717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:16.634397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:16.634845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:16.635292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:16.765671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:16.773522 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-22d73964-72bf-49de-a16a-6737ef97a42f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.151658 Aug 07 12:26:16.774084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 332/635] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:16 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:17.793605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:17.794133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:17.800472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:17.800950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:17.801380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:17.802053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:17.802501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:17.802919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:17.934368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:17.942300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-94983a29-a44e-460d-b29a-7c9424b07354 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.152606 Aug 07 12:26:17.942872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 304/636] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:17 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:18.962760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:18.963401 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:18.970429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:18.970933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:18.971979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:18.972088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:18.972548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:18.972978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:18.975468 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:19.111091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:19.122786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ea3a107e-98c6-48f5-86bf-c3d605488315 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.161555 Aug 07 12:26:19.123592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 333/637] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:18 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:20.145179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:20.145796 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:20.153251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:20.153735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:20.154179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:20.154878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:20.155367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:20.155802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:20.288524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:20.296492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-17112dd8-b76d-4213-a5b9-665a6f4eb0aa tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.155224 Aug 07 12:26:20.297124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 305/638] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:20 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:21.317416 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:21.318021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:21.324902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:21.325400 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:21.329306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:21.329306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:21.329306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:21.329306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:21.458589 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:21.467212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4edf6549-8478-404a-8edb-dd6b5c01f365 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1737 microversion: 2.1 time: 0.153703 Aug 07 12:26:21.467774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 334/639] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:21 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:22.414317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:22.414817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:22.421917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.422393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.422821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.423524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.423972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.424392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.488952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:22.489584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:22.496674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.497161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.497598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.498466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.498923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.499380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.549589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lazy-loading 'services' on Instance uuid f315bf98-44f1-40ea-b836-e2f1baf91992 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:22.632702 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:22.642259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f0df8630-1cdf-42ac-8c2c-c308332cccd8 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1717 microversion: 2.1 time: 0.157233 Aug 07 12:26:22.642773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 335/640] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:22 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:22.752201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:22.752701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:22.758555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.759086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.759528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.760328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.761455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.761894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.796776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0a5f9f5a-0f02-4aa7-8c16-443768194c27 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992/os-volume_attachments/e426f707-4127-458d-8d08-cf9f1239532c" status: 202 len: 0 microversion: 2.1 time: 0.386151 Aug 07 12:26:22.797524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 306/641] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:26:22 2022] DELETE /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992/os-volume_attachments/e426f707-4127-458d-8d08-cf9f1239532c => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:26:22.845358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] HTTP exception thrown: Cannot 'detach_volume' instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 while it is in vm_state rescued Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Request method failure captured: Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments/32da9997-8a3b-4483-ac40-2d906b6bc2e6 HTTP/1.1 Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765lTiZk3RyAxPFqNVeA7LvzADGnZ-Ru0dBpLB3VVpSGqb47_eCoqOp6eL78s9D_vcfNvmC5mALSLE_R-jcQoq89ns2TjgJd9oLJZ5kO-YG2lFRgBVqindnPWSVHFAmqP9olb_mr1R91bJxTM8nK7XVLCfKJ3Hx5xMSsnuz8R7o6kWM Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:26:22.846993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd31c40f797549d082e083324e285b6e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd31c40f797549d082e083324e285b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 90dc7b751dd14c6f80205e709826423b Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:26:22.848784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Cannot 'detach_volume' instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 while it is in vm_state rescued Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'server_id': '8286be07-d68e-431d-9e39-fdc088ca2ec3', 'id': '32da9997-8a3b-4483-ac40-2d906b6bc2e6'} Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:26:22.849953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 while it is in vm_state rescued Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 while it is in vm_state rescued Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:22.852063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Returning 409 to user: Cannot 'detach_volume' instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 while it is in vm_state rescued {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:26:22.853998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8382c296-22f8-4820-b4e0-5844ab7afc4d tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments/32da9997-8a3b-4483-ac40-2d906b6bc2e6" status: 409 len: 152 microversion: 2.1 time: 0.100524 Aug 07 12:26:22.853998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 336/642] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:26:22 2022] DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments/32da9997-8a3b-4483-ac40-2d906b6bc2e6 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 07 12:26:22.857946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:22.858557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:22.864930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.868516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.868516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:22.868516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:22.868516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:22.869501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:23.034828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0a6eb274-a213-4cd5-a9f0-b939a8798213 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/action" status: 202 len: 0 microversion: 2.1 time: 0.181020 Aug 07 12:26:23.035671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 307/643] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:26:22 2022] POST /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:26:23.043762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:23.044409 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:23.050324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:23.050811 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:23.051278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:23.051966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:23.052418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:23.052843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:23.185330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:23.193317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f4fb4936-6c85-4922-b5d4-9645dfae1b01 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1725 microversion: 2.1 time: 0.153450 Aug 07 12:26:23.193880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 337/644] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:23 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:24.215857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:24.216559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:24.222696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:24.223421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:24.227116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:24.227116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:24.227116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:24.227116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:24.379399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:24.388000 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f2fba3b0-8583-4e02-aa6c-3a34e4fb25a5 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1725 microversion: 2.1 time: 0.177865 Aug 07 12:26:24.388580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 308/645] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:24 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:24.976267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:24.976784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:24.983195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:24.983675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:24.984107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:24.984795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:24.985241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:24.985661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:25.009924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:26:25.276983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1a031071-b57f-498d-ac90-c2b7ea28c198 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 204 len: 0 microversion: 2.1 time: 0.304133 Aug 07 12:26:25.277528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 338/646] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:26:24 2022] DELETE /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:26:25.285545 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:25.286179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:25.292802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:25.293279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:25.293736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:25.294420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:25.294862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:25.295304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:25.299455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:25.409633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:25.410341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:25.416290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:25.417326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:25.417755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:25.418537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:25.418994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:25.419445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:25.425238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:25.433207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dfd2f653-8f41-48fe-9cb0-dac0f219254b tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1513 microversion: 2.1 time: 0.150838 Aug 07 12:26:25.433770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 309/647] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:25 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:25.553896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:25.562005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-24c65316-9fb8-42b0-867a-5cc54908ee13 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1725 microversion: 2.1 time: 0.156654 Aug 07 12:26:25.562586 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 339/648] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:25 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:26.454075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:26.454678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:26.461303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:26.461780 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:26.462208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:26.462883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:26.463462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:26.463981 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:26.583317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:26.583934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:26.590889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:26.591418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:26.591889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:26.592593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:26.593056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:26.593486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:26.595329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:26.602624 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f2713668-0cb4-4d19-aa61-d01babb0fc05 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1513 microversion: 2.1 time: 0.152554 Aug 07 12:26:26.603243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 310/649] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:26 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:26.719738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:26.727582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5949bdee-2457-4ec1-8376-95d3871c0647 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1725 microversion: 2.1 time: 0.148094 Aug 07 12:26:26.728146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 340/650] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:26 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:27.580400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:27.580957 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:27.587430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.587906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.588340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.589006 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.589450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.589866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.611571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lazy-loading 'flavor' on Instance uuid ad948861-53f3-4a0f-a3be-1fbef5e5470f {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:27.624938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:27.625556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:27.631913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.632411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.632834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.633521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.633971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.634396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.763953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:27.771859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-58a78925-25e6-45f1-8eb1-a366c012d8f1 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1513 microversion: 2.1 time: 0.150876 Aug 07 12:26:27.772422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 341/651] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:27 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:27.780309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:27.780919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:27.786894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.794629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.794629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.794629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.794629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.795081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.849086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9d86e8cb-b341-4d1a-84a0-aa3de60ab81d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "POST /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f/action" status: 202 len: 0 microversion: 2.1 time: 0.272335 Aug 07 12:26:27.849818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 311/652] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:26:27 2022] POST /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:26:27.858889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:27.859703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:27.865844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.866421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.866862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.867855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:27.868142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:27.868564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:27.926376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:27.935381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f0459fd5-96f3-4e11-bd0e-00a0983c6d80 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1725 microversion: 2.1 time: 0.161950 Aug 07 12:26:27.935958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 342/653] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:27 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:28.005264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:28.013108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8dfb7c87-e496-4264-a8ab-e434c4c77017 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.158840 Aug 07 12:26:28.013685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 312/654] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:27 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:28.792876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:28.793506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:28.799851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:28.800332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:28.800769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:28.801452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:28.801917 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:28.802331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:28.931153 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:28.939031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-22c0e9bf-7ab0-4b82-918e-79bb616094fb tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1513 microversion: 2.1 time: 0.150091 Aug 07 12:26:28.939596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 343/655] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:28 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:28.955820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:28.956525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:28.962823 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:28.963536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:28.964011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:28.964745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:28.965244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:28.965659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.035038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:29.035656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:29.041783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.042314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.045088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.045088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.045088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.045088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.173923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:29.186962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:29.190735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-99937073-2baa-4b19-b749-d713e49d7d95 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1731 microversion: 2.1 time: 0.238834 Aug 07 12:26:29.191562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 313/656] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:28 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:29.194563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a15e9fe4-88d7-4ba9-9ff7-608d1f9737d1 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.163324 Aug 07 12:26:29.195418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 344/657] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:29 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:29.217234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:29.217860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:29.223740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.224221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.224654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.225340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.225851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.226276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.319682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c26c9ae6-6ef9-4f75-9513-44a0353f089f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106643 Aug 07 12:26:29.320477 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 314/658] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:26:29 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:26:29.592999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f315bf98-44f1-40ea-b836-e2f1baf91992", "name": "network-vif-deleted", "tag": "fb0190cb-1c3c-42a2-b345-0c2dafeb090d"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:29.602331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.604673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.604673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.615201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] Creating event network-vif-deleted:fb0190cb-1c3c-42a2-b345-0c2dafeb090d for instance f315bf98-44f1-40ea-b836-e2f1baf91992 on hv-cinder-84984 Aug 07 12:26:29.621006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-d4a635ca-cd73-4159-a820-000b315a95b8 req-fa5badd5-8ce9-4f9b-a17a-f8431592b572 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032004 Aug 07 12:26:29.621613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 345/659] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:26:29.960903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:29.961613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:29.968419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.968929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.972181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:29.972181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:29.972181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:29.972181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:30.000948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:30.001427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:30.001855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:30.002303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lazy-loading 'fault' on Instance uuid f315bf98-44f1-40ea-b836-e2f1baf91992 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:30.046716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b68f7224855a4cec81b664a2573d60f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdb62eaaade46ffa205828d13dba7be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:30.054264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-19fa10b5-ec51-4a71-968c-09c4127141f3 tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 200 len: 1308 microversion: 2.1 time: 0.097266 Aug 07 12:26:30.059658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 315/660] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:29 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:30.218016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:30.218691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:30.224686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:30.225220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:30.225651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:30.226395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:30.226844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:30.227292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:30.421148 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:30.429115 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2b3d48aa-06d9-4947-8d25-5c606f7573da tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.216676 Aug 07 12:26:30.429679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 346/661] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:30 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:30.568051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:30.599509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:30.600534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:30.601579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:30.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] Creating event network-changed:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:26:30.633898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-64de4768-c9c5-4989-b23a-57d452d88974 req-d8ac02aa-b263-46b2-b500-699d362ea0d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071970 Aug 07 12:26:30.634702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 316/662] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:26:31.076047 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:31.076660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] [instance: f315bf98-44f1-40ea-b836-e2f1baf91992] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:31.082791 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:31.083308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:31.083740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:31.084436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:31.085026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:31.085452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:31.101149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] HTTP exception thrown: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Request method failure captured: Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 HTTP/1.1 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi766jEP8-L7Itg_-EEL6IKCd3ZL30vRl-7ezEj3FSNO1iFPl8_CLkWsLGAzEa3xZITj9llpjSonvXpcRsGP11mqo8Y7jcrBwgNk8s0SJvVXrzLOCmecXUj1WIcGx1qvG3-n1b_ehrz0H8iuR02BbAK8K5s5IqEZrCDIbDuitLb6Z0lW0 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 7bdb62eaaade46ffa205828d13dba7be Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:26:31.102837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7bdb62eaaade46ffa205828d13dba7be", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7bdb62eaaade46ffa205828d13dba7be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 7bdb62eaaade46ffa205828d13dba7be Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-591063941 Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesSnapshotTestJSON-591063941-project Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: b68f7224855a4cec81b664a2573d60f1 Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesSnapshotTestJSON-591063941-project Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. Aug 07 12:26:31.105062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'f315bf98-44f1-40ea-b836-e2f1baf91992'} Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:26:31.105951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. Aug 07 12:26:31.107476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:31.111640 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] Returning 404 to user: Instance f315bf98-44f1-40ea-b836-e2f1baf91992 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:26:31.112515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-627ef59f-f2cd-4be1-b3c0-e4e6195c804c tempest-VolumesSnapshotTestJSON-591063941 tempest-VolumesSnapshotTestJSON-591063941-project] 10.222.0.30 "GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992" status: 404 len: 111 microversion: 2.1 time: 0.041210 Aug 07 12:26:31.113317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 347/663] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:31 2022] GET /compute/v2.1/servers/f315bf98-44f1-40ea-b836-e2f1baf91992 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:26:31.451585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:31.452269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:31.458855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:31.459376 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:31.459814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:31.460718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:31.461173 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:31.461773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:31.597102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:31.605292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4630b500-e47b-4779-a4f4-1de30979f021 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.158459 Aug 07 12:26:31.605888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 317/664] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:31 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:32.626364 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:32.626981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:32.633503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:32.633988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:32.634435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:32.635873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:32.636334 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:32.636765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:32.648355 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:32.658087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:32.658561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:32.658987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:32.669787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] Creating event network-changed:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:26:32.674626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-111ba09c-22e4-4e00-8036-f44698bbb4e6 req-c7fc3984-1467-4ecf-a084-f0598b0ae1ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029998 Aug 07 12:26:32.675253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 318/665] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:32.778865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:32.786862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c8dbc62d-e67a-494c-8094-4ea8403ad660 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.164384 Aug 07 12:26:32.787765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 348/666] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:32 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:33.809303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:33.809991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:33.816115 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:33.816533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:33.817007 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:33.817695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:33.818139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:33.818557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:33.954249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:33.961619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-63dc8c2e-6307-4a46-a81a-66f61fbcdc50 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.157190 Aug 07 12:26:33.962178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 319/667] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:33 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:34.982923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:34.983568 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:34.985978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:34.990628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:34.991140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:34.991583 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:34.992276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:34.992744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:34.993150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:35.007966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:35.126984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:35.134594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-17059350-505f-4df9-a4ef-9a37b83acce2 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.155487 Aug 07 12:26:35.135272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 349/668] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:34 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:36.156230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:36.156858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:36.162965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:36.163472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:36.163905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:36.164589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:36.165038 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:36.165517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:36.298347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:36.305898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-653c23f4-1350-4d56-8b2d-51d0d96135ad tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.153553 Aug 07 12:26:36.309655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 320/669] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:36 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:37.327822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:37.328436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:37.334387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:37.334867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:37.335336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:37.336018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:37.336464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:37.336886 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:37.479651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:37.487178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f71573f9-becd-493f-bfa3-8ee26438f1bb tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.163275 Aug 07 12:26:37.487739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 350/670] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:37 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:38.419803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:38.420357 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:38.426623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.427134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.427573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.428254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.428703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.429122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.457493 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-56c9a4fa-aff0-4c01-a61b-ab8006e81d6e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments/128707c4-31a5-4b0c-9945-6cab6505be32" status: 200 len: 194 microversion: 2.20 time: 0.042369 Aug 07 12:26:38.458059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 321/671] 10.222.0.30 () {60 vars in 1454 bytes} [Sun Aug 7 12:26:38 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments/128707c4-31a5-4b0c-9945-6cab6505be32 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:26:38.509918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:38.509918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:38.516806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.517392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.517843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.518544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.519023 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.519474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.524583 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:38.525064 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:38.531569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.532044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.532470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.533149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.533592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.534007 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.613919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lazy-loading 'services' on Instance uuid 4c38525f-a106-4669-87ad-fd3e321a65d7 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:38.654789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:38.662405 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1f59cd31-c99a-4698-8566-2965cb7decd3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.157308 Aug 07 12:26:38.662977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 351/672] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:38 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:38.831684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-edcab331-12af-4f00-b9ec-bf40901ac10d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments/128707c4-31a5-4b0c-9945-6cab6505be32" status: 202 len: 0 microversion: 2.20 time: 0.310728 Aug 07 12:26:38.832304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 322/673] 10.222.0.30 () {60 vars in 1457 bytes} [Sun Aug 7 12:26:38 2022] DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments/128707c4-31a5-4b0c-9945-6cab6505be32 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 12:26:38.840936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:38.843155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:38.849095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.849581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.850022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.850716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:38.851236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:38.854260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:38.882472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f7599f7e-29e1-43ca-91f3-1e18676bffbb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045660 Aug 07 12:26:38.883297 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 352/674] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 12:26:38 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:26:39.685917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:39.686726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:39.693219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:39.693696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:39.694123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:39.694808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:39.695286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:39.695733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:39.844847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:39.852715 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3b9f7e1e-1e84-4a63-8bd6-c83f4c9ae30d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.171983 Aug 07 12:26:39.861317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 323/675] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:39 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:39.895634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:39.897815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:39.905537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:39.906022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:39.906455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:39.907268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:39.907720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:39.908187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:39.937891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fe0c0553-9055-4ddb-82e3-301d94c9c7bb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046194 Aug 07 12:26:39.938458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 353/676] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 12:26:39 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:26:40.873733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:40.874498 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:40.877179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=48 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:40.882579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:40.882820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:40.883279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:40.883977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:40.884433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:40.884855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:40.904068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:40.950659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:40.952865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:40.961090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:40.961574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:40.962008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:40.964298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:40.965073 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:40.967557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:40.998730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1da4c720-8d97-479e-967a-c50ff052165e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052616 Aug 07 12:26:40.999333 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 354/677] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 12:26:40 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:26:41.020975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:41.029039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1e152ada-448c-459b-8682-bca08554e1d0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.159349 Aug 07 12:26:41.031397 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 324/678] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:40 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:42.011260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:42.013526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:42.020413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.020910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.021351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.022053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.022681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.023148 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.051621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:42.052217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:42.055044 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b2822ee7-b896-4733-adde-3607d2c003ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048003 Aug 07 12:26:42.055804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 355/679] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 12:26:42 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:42.061636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.061875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.062399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.063118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.063565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.063985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.194843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:42.203182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-16b7cc70-bd57-46c5-924d-ef91f05b5a0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.157012 Aug 07 12:26:42.203754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 325/680] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:42 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:42.295090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:42.295595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:42.302365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.302852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.303327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.304015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.304466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.304894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.329722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:26:42.621639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-43eebabd-fe7e-4119-9809-e60f11d99e7a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 204 len: 0 microversion: 2.20 time: 0.330722 Aug 07 12:26:42.622239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 356/681] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 12:26:42 2022] DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 12:26:42.630382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:42.631229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:42.637660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.638149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.638693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.639401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:42.640098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:42.640517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:42.771099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:42.779726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:42.781291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:42.782444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cb12a5fd-d394-4e23-bec1-9b8672b9a9bf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.156018 Aug 07 12:26:42.783012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 326/682] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:42 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:43.228206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:43.228915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:43.235446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:43.235932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:43.236373 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:43.237063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:43.237521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:43.237946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:43.374950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:43.382389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fb648c0b-74dd-45a1-b478-4103784fd2ea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.158498 Aug 07 12:26:43.382957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 357/683] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:43 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:43.805690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:43.806308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:43.812728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:43.813206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:43.813640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:43.814326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:43.814788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:43.815232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:43.944978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:43.953042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:43.954528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:43.955703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1fadda2f-3284-4c5b-a18d-462e235b070a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.154086 Aug 07 12:26:43.956260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 327/684] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:43 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:44.405281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:44.406223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:44.413289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:44.413769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:44.414207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:44.414962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:44.415940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:44.416548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:44.548512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:44.555960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-73132a78-cd89-4bd2-b0b8-a44bc53312b7 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.155475 Aug 07 12:26:44.556549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 358/685] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:44 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:44.979081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:44.979788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:44.986077 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:44.986552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:44.986982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:44.987689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:44.988137 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:44.988559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.048520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:45.050682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:45.056762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.057300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.057742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.058435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.058888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.059340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.280683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:45.288560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:45.290049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:45.291270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0d011b98-69fd-4c09-a205-9cc8845a8bb8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.316312 Aug 07 12:26:45.292455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 328/686] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:44 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:45.337147 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c52b2fd0-4224-4d5b-bb50-9f07f2207a6c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action" status: 202 len: 0 microversion: 2.1 time: 0.292190 Aug 07 12:26:45.340803 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 359/687] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:26:45 2022] POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:26:45.346445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:45.347188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:45.354531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.354531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.354531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.354966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.355467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.355892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.495790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:45.503751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e52b974e-55e9-424c-a02b-f022c5bd5cd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1750 microversion: 2.1 time: 0.161619 Aug 07 12:26:45.504324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 329/688] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:45 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:45.578564 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:45.579296 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:45.585427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.585989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.586429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.587149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.587785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.588371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.728091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:45.736157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d4c0348e-0b53-4d96-bf39-cdb8dfcafeea tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.161869 Aug 07 12:26:45.736632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 360/689] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:45 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:45.843908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "name": "network-vif-unplugged", "status": "completed", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:45.853517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:45.854579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:45.854579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:45.865256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] Creating event network-vif-unplugged:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:26:45.870473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-0b3b8e92-a791-4bbd-8cab-000b3b8703ab req-e2118c57-7b8f-4efc-95bf-6136472ef1a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030164 Aug 07 12:26:45.871019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 330/690] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:26:45.999167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:45.999662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.005574 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.006055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.006492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.007207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.007662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.008145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.031691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9ffaec08-5b77-4db4-a4ac-0f58ce7e88cf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/ips" status: 200 len: 150 microversion: 2.1 time: 0.036386 Aug 07 12:26:46.032266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 361/691] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:26:45 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:46.044932 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edae3f32-db97-4d63-9806-940ae065c9f1"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:46.047435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.053530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.054003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.054433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.055185 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.055632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.056580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.136931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: POST /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/os-volume_attachments HTTP/1.1 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 74 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:26:46.138873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {"volumeAttachment": {"volumeId": "edae3f32-db97-4d63-9806-940ae065c9f1"}} Aug 07 12:26:46.140781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'server_id': '7d749f04-654d-4f11-8827-2849cd637994', 'body': {'volumeAttachment': {'volumeId': 'edae3f32-db97-4d63-9806-940ae065c9f1'}}} Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:46.141742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:46.143204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 400 to user: Invalid volume: volume edae3f32-db97-4d63-9806-940ae065c9f1 is already attached to instances: 9a26c053-8ae7-4956-9ffa-ae344cea68e3 {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-813eeb5f-6174-46dc-a3c1-ab13435333e0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100578 Aug 07 12:26:46.144752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 331/692] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:26:46 2022] POST /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:26:46.149559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:46.150181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.156254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.156746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.157187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.157881 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.158337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.158764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.183778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:26:46.215958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:46.314638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:46.315427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.322892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.323408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.323843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.325104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.325104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.325501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.553958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f64a6b16-2fc9-43c4-a69d-44f8b44b070a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 204 len: 0 microversion: 2.1 time: 0.406882 Aug 07 12:26:46.556141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 362/693] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:26:46 2022] DELETE /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:26:46.561068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:46.561770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.568345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.568828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.569259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.569945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.570398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.570821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.630317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:46.642602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:46.644567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:46.648248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5063f0ac-a5bb-4ab9-97d4-803971358905 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1723 microversion: 2.20 time: 0.337290 Aug 07 12:26:46.656111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 332/694] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:46 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:46.661243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:46.661927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.668366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.668962 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.669484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.670252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.670874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.671472 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.809084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:46.817171 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ffc81509-73ef-4d2d-b739-bf6b86be88e0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1750 microversion: 2.1 time: 0.260978 Aug 07 12:26:46.817740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 363/695] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:46 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1750 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:46.835384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:46.842925 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:46.842925 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.843320 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.843590 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:46.844505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:46.844956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:46.845636 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.006307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.017134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fc31697b-b3a5-4e7f-8ecd-5150c758ec79 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1570 microversion: 2.1 time: 0.185478 Aug 07 12:26:47.017714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 364/696] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:46 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:47.035876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.038701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:47.039344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:47.045770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.046138 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ee1939d5-19aa-405f-b6f8-af8989fdcd05 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1682 microversion: 2.1 time: 0.388642 Aug 07 12:26:47.046609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.046709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.046795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 333/697] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:46 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1682 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:47.047389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.047840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.048265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.098129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118242) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 12:26:47.377949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-813b41b6-4b89-4308-ae43-13c6ee3c0aac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "POST /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f/action" status: 202 len: 0 microversion: 2.1 time: 0.343284 Aug 07 12:26:47.378853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 365/698] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:26:47 2022] POST /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:26:47.388008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:47.388759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:47.397410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.398001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.398433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.399187 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.399768 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.400443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.673986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:47.674495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:47.681001 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.681613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.682218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.682961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.683468 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.684105 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.768187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.778141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.779844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.781700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d38bf5a7-2a5b-473e-9eb1-f9b6c6a6d625 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1656 microversion: 2.20 time: 0.112235 Aug 07 12:26:47.782340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 366/699] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:47 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1656 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:26:47.798322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:47.808706 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5154cbd9-ede0-423c-88e8-520e20a67aed tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1518 microversion: 2.1 time: 0.425562 Aug 07 12:26:47.809232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 334/700] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:47 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:47.838965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:47.840144 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:47.846478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.846963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.847428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.848117 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.849016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.849595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.951456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c38525f-a106-4669-87ad-fd3e321a65d7", "name": "network-vif-deleted", "tag": "bdcf9b1c-1082-4b8f-b68e-102077645e13"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:47.961919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:47.962587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:47.963246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:47.975296 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] Creating event network-vif-deleted:bdcf9b1c-1082-4b8f-b68e-102077645e13 for instance 4c38525f-a106-4669-87ad-fd3e321a65d7 on hv-cinder-84984 Aug 07 12:26:47.981558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-cdce9eaf-695d-4e2c-96a2-53476e42cd01 req-1a6d8575-c72f-4d5c-871b-a6ad1284dc3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034693 Aug 07 12:26:47.982380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 335/701] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:48.044218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:48.052690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-83182594-bbb5-45a4-bfb9-a9aa8635de17 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1750 microversion: 2.1 time: 0.218929 Aug 07 12:26:48.056905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 367/702] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:47 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:48.075505 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:48.076215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:48.082922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.083592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.084353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.093245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.096302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.096754 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.331398 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:48.339529 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6927e6f3-71e7-455c-ac84-433fded1f780 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1682 microversion: 2.1 time: 0.270219 Aug 07 12:26:48.340094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 336/703] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:48 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1682 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:48.806685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:48.807848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:48.814914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.815760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.816464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.817651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.818253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.819060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.829902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:48.844307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:48.844307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.844307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.844307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.844743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.844913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.845437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.870282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:48.870785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:48.871259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:48.871723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lazy-loading 'fault' on Instance uuid 4c38525f-a106-4669-87ad-fd3e321a65d7 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:48.957243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:48.966644 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:48.968242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:48.970058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-849abff2-0e8f-46de-aab3-3c226871ac43 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 200 len: 1371 microversion: 2.20 time: 0.167546 Aug 07 12:26:48.983884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 368/704] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:48 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:49.079635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:49.081406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:49.089076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:49.089708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:49.090274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:49.091459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:49.097404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:49.097404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:49.203350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:49.231993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c7e21dd4-6f11-4059-abb1-3f53b353f89a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1518 microversion: 2.1 time: 0.405806 Aug 07 12:26:49.233816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 337/705] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:48 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1518 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:49.369001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:49.373623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:49.393580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:49.402794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:49.407252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:49.409108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:49.410897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:49.419859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:49.465006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:49.475737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ab0b522a-fbf9-4284-bc7f-7b1d9c608d19 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1750 microversion: 2.1 time: 0.405428 Aug 07 12:26:49.493095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 369/706] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:49 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1750 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:49.934005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:49.949653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2172b6cc-c105-4b19-a320-297e262103df tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1682 microversion: 2.1 time: 0.586082 Aug 07 12:26:49.950378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 338/707] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:49 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1682 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:49.995556 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:49.996150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:50.003056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.003472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.004084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.005162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.005770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.006346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.020998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 HTTP/1.1 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:26:50.022709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:26:50.024380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '4c38525f-a106-4669-87ad-fd3e321a65d7'} Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:26:50.025625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:26:50.027111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:26:50.029050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:26:50.030240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e2ba7270-c85b-44d9-bb5f-17457b37c4ce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 404 len: 111 microversion: 2.20 time: 0.039465 Aug 07 12:26:50.032089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 370/708] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:49 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:26:50.040789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-182c5329-1ad4-4f1e-be57-1323adbc26ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '.version_select at 0x7f779760cf70>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:50.154179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-182c5329-1ad4-4f1e-be57-1323adbc26ee tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296144357" status: 204 len: 0 microversion: 2.20 time: 0.117661 Aug 07 12:26:50.155165 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 339/709] 10.222.0.30 () {60 vars in 1262 bytes} [Sun Aug 7 12:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1296144357 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 07 12:26:50.257910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:50.258833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:50.265452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.266180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.266785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.267515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.267971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.268396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.413505 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d749f04-654d-4f11-8827-2849cd637994", "name": "network-vif-deleted", "tag": "eed64b0a-cc21-4240-b190-0a8deaf90077"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:50.434771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:50.441144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.441737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.442426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.447501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aecdc750-5af1-413a-a931-ad7b3d97e687 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1520 microversion: 2.1 time: 0.193449 Aug 07 12:26:50.448087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 371/710] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:50 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:50.457417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] Creating event network-vif-deleted:eed64b0a-cc21-4240-b190-0a8deaf90077 for instance 7d749f04-654d-4f11-8827-2849cd637994 on hv-cinder-84984 Aug 07 12:26:50.465346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-c3cf8443-f6ba-4b2d-b48b-c45fc7f786b2 req-e0301198-1599-472b-ac83-014d88f755c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055322 Aug 07 12:26:50.466036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 340/711] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:50.501855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:50.512684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:50.522328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.523024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.523989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.526206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.526909 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.527701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.785496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:50.795094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b77d341f-5c68-4832-8e20-6734e8772dd0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.297148 Aug 07 12:26:50.811035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 372/712] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:50 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:50.975171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:50.976520 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:50.983812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.984486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.984924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:50.985626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:50.986111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:50.986752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:51.023368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:51.023907 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:51.024399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:51.025616 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'fault' on Instance uuid 7d749f04-654d-4f11-8827-2849cd637994 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:51.068540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:51.077040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-31e1783f-327d-4f15-aaa2-f43cedf74a2d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 200 len: 1331 microversion: 2.1 time: 0.106782 Aug 07 12:26:51.077705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 341/713] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:50 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:51.242830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e9d91ee1-0160-4b83-9787-66eb3870fbcc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: .version_select at 0x7f7797fb2700>, body: {"keypair": {"name": "tempest-keypair-1426158722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5I0EY38HzFPLKQ/jJMUZTBmf21CJRok6+ttyH+fgZQKQVXpu/k3Mtd0v/txo0+idq1ilvXToCtgZSjMB32scPvnGdYiOiIt3JHTmt8BTjgSuCF6TSOf6NNVE5HFE0CmA=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:51.260051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-e9d91ee1-0160-4b83-9787-66eb3870fbcc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for project 547ebf661b1b48f289d734a71b494889. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:26:51.264090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-e9d91ee1-0160-4b83-9787-66eb3870fbcc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for user c8fb20cfc3b6479198059b4383f47527 and project 547ebf661b1b48f289d734a71b494889. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:26:51.359686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e9d91ee1-0160-4b83-9787-66eb3870fbcc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120762 Aug 07 12:26:51.360288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 373/714] 10.222.0.30 () {62 vars in 1200 bytes} [Sun Aug 7 12:26:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 07 12:26:51.468809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:51.469422 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:51.475753 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:51.476232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:51.476738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:51.491815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:51.492484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:51.492955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:51.644770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:51.653602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5d45bfe5-4531-4faf-a581-de8b83478c0a tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1520 microversion: 2.1 time: 0.188586 Aug 07 12:26:51.654479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 342/715] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:51 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:51.822729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:51.823157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:51.829432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:51.829922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:51.830391 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:51.831166 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:51.831651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:51.832075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:52.020961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:52.029185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-86e2ca12-e710-4634-a003-c35931503b48 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.211332 Aug 07 12:26:52.029792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 374/716] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:51 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:52.100147 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:52.100785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:52.107723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:52.108302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:52.108738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:52.109435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:52.110037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:52.110297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:52.124851 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 HTTP/1.1 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:26:52.126512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:26:52.128159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '7d749f04-654d-4f11-8827-2849cd637994'} Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:26:52.129157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:26:52.130585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:26:52.131942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:26:52.131942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-51001b48-c78f-4727-a63d-d6c0681acf50 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 404 len: 111 microversion: 2.1 time: 0.031837 Aug 07 12:26:52.131942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 343/717] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:52 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:26:52.137870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-728804de-9edb-4698-a958-ac9089eec6de tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '.version_select at 0x7f7797f4c820>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:52.232242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-728804de-9edb-4698-a958-ac9089eec6de tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530513724" status: 202 len: 0 microversion: 2.1 time: 0.099134 Aug 07 12:26:52.232938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 375/718] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 12:26:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530513724 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:26:52.675037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:52.675646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:52.682804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:52.683562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:52.684019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:52.685048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:52.685396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:52.685777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:52.707290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:52.864895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:52.872409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-435e10ce-1554-4bb1-bc72-7eeecb55b47b tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.201467 Aug 07 12:26:52.873027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 344/719] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:52 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:53.053164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:53.054039 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:53.060398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.060936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.061371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.062056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.062507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.062931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.380228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:53.398332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dff64373-fb55-445d-aea1-5a2287156a96 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.350746 Aug 07 12:26:53.399034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 376/720] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:53 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:53.445273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:53.445273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:53.447732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.448214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.448647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.449341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.459354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.459854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.561895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'services' on Instance uuid 9a26c053-8ae7-4956-9ffa-ae344cea68e3 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:26:53.797869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-16d4c365-d8d5-4cd7-a809-a3c0e544430a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments/edae3f32-db97-4d63-9806-940ae065c9f1" status: 202 len: 0 microversion: 2.1 time: 0.360524 Aug 07 12:26:53.801840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 345/721] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:26:53 2022] DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments/edae3f32-db97-4d63-9806-940ae065c9f1 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:26:53.808276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:53.810875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:53.817720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.818639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.819657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.820511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.821022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.821643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.853856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a87e87e8-6242-4d9a-afba-95031ff09efe tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Aug 07 12:26:53.854715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 377/722] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:26:53 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:53.893940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:53.894808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:53.901908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.902544 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.903096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:53.904016 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:53.904721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:53.905244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.102958 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:54.115983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-51fe22ba-5f57-4f1a-98de-b161dc125993 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.226440 Aug 07 12:26:54.117127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 346/723] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:53 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:54.307627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1956354278", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d6ddf0f-3edc-45fa-b4b0-45d5e0c63b14"}], "security_groups": [{"name": "tempest-securitygroup--2004477379"}], "key_name": "tempest-keypair-1426158722", "user_data": "}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:26:54.415979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] validate_networks() for [('0d6ddf0f-3edc-45fa-b4b0-45d5e0c63b14', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:26:54.421360 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:54.422149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:54.428210 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.428749 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.431118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.431118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.431118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.431118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.584689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:54.594073 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-95aef47b-ef42-4401-a901-b1dd9eb669f5 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.177133 Aug 07 12:26:54.594844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 347/724] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:54 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:54.801823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:26:54.802252 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:26:54.802725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:26:54.803192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:26:54.803734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:26:54.812852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.813347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.813812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.814535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.814981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.815429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.832438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for project 547ebf661b1b48f289d734a71b494889. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:26:54.836367 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Getting quotas for user c8fb20cfc3b6479198059b4383f47527 and project 547ebf661b1b48f289d734a71b494889. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:26:54.839658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:54.848807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:26:54.851065 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:26:54.865812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:54.868165 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:54.874719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.875230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.875668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.876362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:54.876812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:54.877278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:54.907381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d887798f-aa1e-4fc0-a607-497565a356a0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Aug 07 12:26:54.907929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 348/725] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:26:54 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:26:54.969793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c2059c3d-aaef-4e8a-b93e-e4826e0cc664 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.667366 Aug 07 12:26:54.970704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 378/726] 10.222.0.30 () {62 vars in 1188 bytes} [Sun Aug 7 12:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 07 12:26:54.981875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:54.982487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:55.039099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:55.049133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:55.051988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:55.053492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d6944876-b8fc-49d1-b089-6c218f413247 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1282 microversion: 2.20 time: 0.075756 Aug 07 12:26:55.059132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 349/727] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:54 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:55.138381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:55.139026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:55.145976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.146463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.146904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.147642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.148129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.148573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.284640 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:55.292352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e77c6191-40e6-48c1-a6aa-45ee976f837d tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.158554 Aug 07 12:26:55.294002 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 379/728] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:55 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:55.617230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:55.617838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:55.624752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.625235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.625667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.626352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.626858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.627303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.775399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:55.783464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e0e2f390-a98f-41c2-8b8a-020b9ae3e17d tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.169923 Aug 07 12:26:55.783866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 350/729] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:55 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:55.920000 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:55.922267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:55.929734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.930237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.931404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.932128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:55.932581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:55.933031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:55.957384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:26:55.963771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12c695ed-dc40-4fec-bfdb-717fe5defb55 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047833 Aug 07 12:26:55.964351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 380/730] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:26:55 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 12:26:56.028102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:56.028897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:56.035442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.036255 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.036367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.037003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.037452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.037871 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.063516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:26:56.078003 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:56.078705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:56.085023 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.085510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.085949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.086676 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.087157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.087814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.151820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.160500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.161477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.162592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4a0fa03c-be15-4468-a749-dc172cccc24b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1286 microversion: 2.20 time: 0.089031 Aug 07 12:26:56.163445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 381/731] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:56 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:26:56.312592 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:56.313210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:56.320096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.320586 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.321063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.321806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.322260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.322689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.369235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1a1c9e6c-d0ca-46e9-ae13-c2eff3e3025c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 204 len: 0 microversion: 2.1 time: 0.344475 Aug 07 12:26:56.370514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 351/732] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:26:56 2022] DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:26:56.380759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:56.381473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:56.388304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.388788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.389244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.390284 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.390662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.391113 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.532783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.541591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9a781a6d-c3b4-44ae-b3df-c34ac4ac5e2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1681 microversion: 2.1 time: 0.164917 Aug 07 12:26:56.542177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 352/733] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:56 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:56.698458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.705936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b9398fd8-7ef4-4dc1-ae92-de3e43a660dd tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.397222 Aug 07 12:26:56.706502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 382/734] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:56 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:26:56.804228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:56.804764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:56.810867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.811380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.811855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.812564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:56.813025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:56.813448 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:56.959945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:56.968588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-877faa0d-9ceb-40bc-ae9c-9eae42c2cd0c tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.168372 Aug 07 12:26:56.969159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 353/735] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:56 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:57.185269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:57.185884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:57.192638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.193126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.193578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.194253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.194708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.195176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.257542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:57.265882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:57.267421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:57.268550 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-37cee629-15bf-4ab3-a197-c1701c7989c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1334 microversion: 2.20 time: 0.088010 Aug 07 12:26:57.269104 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 383/736] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:57 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:57.562455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:57.563085 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:57.569763 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.570250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.570685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.572031 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.572484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.572905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.703962 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:57.712290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-806f883b-9429-4e56-a27d-9d018f4e8679 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1681 microversion: 2.1 time: 0.153563 Aug 07 12:26:57.712892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 354/737] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:57 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:57.727920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:57.728570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:57.734596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.735114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.735554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.736240 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.736717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.737143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.882293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:57.891324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-53b0b439-64a3-482e-af6c-e22c688b1bd0 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.167888 Aug 07 12:26:57.893359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 384/738] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:57 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:57.989973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:57.992135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:57.997506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.998016 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:57.998450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:57.999231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:57.999682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.000105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.170778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:58.183759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ebde8052-e90e-401e-8ebe-a26e4d638e73 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.197942 Aug 07 12:26:58.184545 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 355/739] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:57 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:58.292009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:58.297624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:58.299972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.300457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.300895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.301614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.302072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.302497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.365706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:58.373679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:58.375200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:58.376399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d9dfe8c1-d22d-4397-9dbc-3bcd01457435 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1334 microversion: 2.20 time: 0.089231 Aug 07 12:26:58.376955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 385/740] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:58 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:26:58.733941 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:58.734643 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:58.741817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.742301 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.743273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.744158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.744620 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.745048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.890106 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:58.895985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-17b327a4-cbc1-4253-9cf2-1eef0f3ffd78 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1681 microversion: 2.1 time: 0.166006 Aug 07 12:26:58.896799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 356/741] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:58 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:58.912578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:58.913265 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:58.919349 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.920121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.920649 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:58.921423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:58.922057 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:58.922486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.073885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:59.083521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e72690e3-6935-4f17-88e6-679256d71f3f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.174710 Aug 07 12:26:59.084239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 386/742] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:58 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:59.205182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:59.205811 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:59.212742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.213240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.213683 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.214402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.214887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.215518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.375188 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:59.383593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8bcdafcf-791c-49a2-af40-bae24a537978 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.182312 Aug 07 12:26:59.384343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 357/743] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:59 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:26:59.626209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:59.626875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:59.636717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.637315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.637827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.638662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.639238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.640136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.714385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:59.723978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:59.725666 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:26:59.727129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8acbcc24-4982-4c71-9a10-aeee92fcdf78 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1342 microversion: 2.20 time: 0.332077 Aug 07 12:26:59.728351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 387/744] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:26:59 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:26:59.920960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:26:59.921494 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:26:59.928152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.928642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.929080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:26:59.929785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:26:59.930773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:26:59.931235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.105038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:00.105663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:00.113793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.114289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.114732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.115507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.115986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.116429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.196780 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.205629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9a504ee8-7470-4e53-a8b3-f1d959cfea6f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1681 microversion: 2.1 time: 0.288635 Aug 07 12:27:00.206213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 358/745] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:26:59 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:00.256943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.265899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7528377b-685e-4b72-b5e5-eabeca7f3e09 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.165108 Aug 07 12:27:00.266560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 388/746] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:00 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:00.405126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:00.405796 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:00.411567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.412044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.412478 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.413156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.413602 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.414015 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.706535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.710044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:00.714917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-925d955a-24d8-4be9-9ade-926ee3fef919 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.313732 Aug 07 12:27:00.715547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 359/747] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:00 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:00.754919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:00.755671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:00.762322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.762905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.763442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.764209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:00.764919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:00.765345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:00.828566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.837412 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.840692 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:00.840692 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-24942017-87c0-4dfd-94dc-f924a7d6b2e7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1340 microversion: 2.20 time: 0.089183 Aug 07 12:27:00.840975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 389/748] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:00 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:01.228483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:01.229720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:01.237387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.237795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.238228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.238930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.239624 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.240091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.287257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:01.288286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:01.294713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.295342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.295900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.296704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.301236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.301236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.324728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:01.358150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c1b5347f-5a64-4f80-a869-99c64306eec2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1613 microversion: 2.1 time: 0.133474 Aug 07 12:27:01.359356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 360/749] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:01 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1613 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:01.406368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a26c053-8ae7-4956-9ffa-ae344cea68e3", "name": "network-vif-deleted", "tag": "6dfb8044-a614-4cd6-b9ed-d0187b469bdc"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:01.420390 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.421079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.427491 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.435103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] Creating event network-vif-deleted:6dfb8044-a614-4cd6-b9ed-d0187b469bdc for instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 on hv-cinder-84984 Aug 07 12:27:01.440365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-1bb18fe9-9c3b-482d-ba50-be67188fe62c req-f288a958-686e-4bce-a3b6-2e34bcdc9af9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039890 Aug 07 12:27:01.441351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 361/750] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:27:01.464542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:01.472102 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-8401313f-c7c3-435f-a4d5-4bee103f7050 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.188741 Aug 07 12:27:01.472793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 390/751] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:01 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:01.737554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:01.738262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:01.745448 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.745942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.746383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.747235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.747638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.748061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.863194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:01.864451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:01.879457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.879958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.880497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:01.881217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:01.881687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:01.882106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.046471 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.048399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.054665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d2b9a965-74ff-4dfe-b999-333aab3c1bd4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.321331 Aug 07 12:27:02.056407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 362/752] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:01 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:02.075674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.080112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.080454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-32c53a1a-8726-4f1e-8339-4c688399a1c6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.220708 Aug 07 12:27:02.092830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 391/753] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:01 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:02.380309 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:02.381098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:02.388872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:02.389718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:02.390126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.390918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:02.391431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:02.391847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.423674 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:02.424573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:02.424718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.425054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'fault' on Instance uuid 9a26c053-8ae7-4956-9ffa-ae344cea68e3 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:02.494449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:02.494872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.495224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:02.502904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:02.503713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:02.504322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.504598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f058dd2b-ecd4-4b20-ae17-8b3c9a2e5c30 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 200 len: 1330 microversion: 2.1 time: 0.128311 Aug 07 12:27:02.505383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:02.505708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 363/754] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:02 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:02.506330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:02.516910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:02.701923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:02.709888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-af851860-ccd3-4810-a389-7301c68ff77f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.220209 Aug 07 12:27:02.714720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 392/755] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:02 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:03.078018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:03.078611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:03.084648 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.085131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.087830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.087830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.087830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.087830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.104477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:03.106027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:03.112587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.113894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.114329 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.115038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.115992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.116620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.253837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:03.262595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:03.264131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:03.265507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fdf8afc8-611d-42db-900d-d6ccc4235f1d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.164978 Aug 07 12:27:03.266067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 393/756] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:03 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:03.325762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:03.333827 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-456d67d8-b9e2-48d0-8c69-5acee20ecab4 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.259978 Aug 07 12:27:03.334495 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 364/757] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:03 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:03.455834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:03.465129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.465594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.466016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.476670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] Creating event network-changed:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:27:03.481584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-1826058c-0641-49f8-89f5-987ddd767d8f req-3e209aa5-2a25-4afe-aa5c-66a3fca03a70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029410 Aug 07 12:27:03.482316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 394/758] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:03.527302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:03.527886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:03.534326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.534806 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.535271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.536041 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.536486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.536902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.550316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 HTTP/1.1 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:27:03.551980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:27:03.553575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '9a26c053-8ae7-4956-9ffa-ae344cea68e3'} Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:03.554641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:27:03.558992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:03.560315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:03.560315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-88b52811-8795-4618-a63c-0fbcb9f21c07 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 404 len: 111 microversion: 2.1 time: 0.030232 Aug 07 12:27:03.560315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 365/759] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:03 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:03.563943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6478a90c-af74-47bb-8486-d5dbfdc099a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '.version_select at 0x7f7797ed9820>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:03.624931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6478a90c-af74-47bb-8486-d5dbfdc099a9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-215805402" status: 202 len: 0 microversion: 2.1 time: 0.065237 Aug 07 12:27:03.625521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 395/760] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 12:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-215805402 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:03.731874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:03.732515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:03.738564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.739078 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.739514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.740423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.740872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.741469 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.823184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "name": "network-vif-plugged", "status": "completed", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:03.833195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:03.834118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:03.834913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:03.850408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] Creating event network-vif-plugged:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:27:03.855615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-b046c554-6f81-4c54-9320-d1c2d7ef7605 req-6231a82d-fb21-49f1-b79d-d0f514014414 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038321 Aug 07 12:27:03.856213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 396/761] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:03.909567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:03.917899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-650b3806-cd89-4259-86f9-6e220c323917 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.190732 Aug 07 12:27:03.918775 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 366/762] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:03 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:04.291800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:04.292508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:04.298624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.299140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.299578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:04.300268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.300723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.301290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:04.355843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:04.356665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:04.362699 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:04.364218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.364950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.365406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:04.366184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.366838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.367965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:04.437511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:04.445950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:04.447864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:04.448997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ba27b3d9-0219-4d8e-8890-5855d4d583ef tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.163809 Aug 07 12:27:04.449559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 397/763] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:04 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:04.454232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-597352b6-1185-4dd6-831a-44b47b0f5010 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: .version_select at 0x7f7797ed93a0>, body: {"keypair": {"name": "tempest-keypair-892588261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg6jhbS1nQQT3zExIRo3GfkV6aMifKpdLpJkQwBx+veg8+SIoTXR7izH0ZMyc2x5PJjOIA0NWMIzYiFpCm+v1W+Pj1vgwLSWYS5QFK+Hy5LKxj5kjdypx65k07az3O9Pg=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:04.470739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-597352b6-1185-4dd6-831a-44b47b0f5010 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:27:04.475158 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-597352b6-1185-4dd6-831a-44b47b0f5010 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:27:04.561420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:04.562541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-597352b6-1185-4dd6-831a-44b47b0f5010 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.111915 Aug 07 12:27:04.563316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 398/764] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:27:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:04.569658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-290e1853-e98c-46c1-aeab-610ea0f02633 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.218434 Aug 07 12:27:04.570227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 367/765] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:04 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:04.936197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:04.940218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:04.940836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:04.947726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.948218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.948664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:04.949364 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:04.949822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:04.950662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:05.087408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:05.095102 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-090099f3-b882-4194-8f4d-d81abd39e875 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.159752 Aug 07 12:27:05.095687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 399/766] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:04 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:05.472254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:05.475576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:05.475576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:05.480552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:05.481107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:05.481535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:05.482252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:05.482699 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:05.483144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:05.632368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:05.641029 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:05.642476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:05.643613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-eeaf5aa2-8260-4b80-8b78-a94d99136520 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.175384 Aug 07 12:27:05.644179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 368/767] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:05 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:05.651488 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:05.652106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:05.658932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:05.659483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:05.659924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:05.660620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:05.661073 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:05.661504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:05.812799 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:05.815055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:05.824755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-660b95ee-f779-4ae7-ac9f-a2375c1058a0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.174870 Aug 07 12:27:05.824755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 400/768] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:05 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:06.116667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:06.117314 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:06.129447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.130183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.133675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:06.133675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.133675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.133675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:06.274350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:06.282111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bb4b8f37-f42f-41dc-8c2d-6ad66f92ac2f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1576 microversion: 2.1 time: 0.169445 Aug 07 12:27:06.282680 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 369/769] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:06 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:06.667345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:06.667922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:06.674669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.675290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.675739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:06.676461 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.676923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.677364 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:06.822005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:06.830476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:06.832006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:06.833133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7f53096f-3d62-4659-af5f-62cb1fe78400 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.171107 Aug 07 12:27:06.833700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 401/770] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:06 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:06.842825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:06.843636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:06.850615 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.851129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.860166 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:06.861163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:06.861648 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:06.862079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.038622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:07.047392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c982c555-b4d6-45a8-bda6-9accbf0cb48e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.208327 Aug 07 12:27:07.047980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 370/771] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:06 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:07.283657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111850477", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d3266-c358-4a1b-818a-9b2ef5a91e93"}], "security_groups": [{"name": "tempest-securitygroup--944358217"}], "key_name": "tempest-keypair-892588261", "user_data": "}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:07.303662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:07.304576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:07.310663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.311275 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.311785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.312546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.313129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.313547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.388508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] validate_networks() for [('722d3266-c358-4a1b-818a-9b2ef5a91e93', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:27:07.443783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:07.452105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-339f8e6c-6699-4a7d-9131-6ebfe6028544 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1563 microversion: 2.1 time: 0.152568 Aug 07 12:27:07.467212 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 371/772] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:07 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:07.853891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:27:07.854784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:27:07.855298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:27:07.856232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:27:07.856588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:07.856996 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:27:07.857196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:07.864204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.864689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.865123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.866005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.866495 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.866632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.867152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.867589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.867750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.868412 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:07.868869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:07.869301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:07.891355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:27:07.895742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:27:07.907905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:27:07.910203 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:27:08.006731 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:08.015970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:08.017460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:08.018558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1f59ff5c-6797-43c5-bd62-c21f7ba3d442 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.165864 Aug 07 12:27:08.019142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 372/773] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:07 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:08.023972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "name": "network-vif-plugged", "status": "completed", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:08.033421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:08.033897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:08.034313 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:08.045883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] Creating event network-vif-plugged:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:27:08.050469 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-825e40e8-0bd0-45c4-81ad-8d323b32fdb2 req-551cf2fe-c532-49e2-93fd-ec9c2f131d1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Aug 07 12:27:08.051079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 373/774] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:08.068931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:08.069649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:08.076107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:08.076584 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:08.077013 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:08.077688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:08.078134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:08.078581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:08.103318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a5463cf7-c72f-4df6-a17c-8b5d9bddd672 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.823810 Aug 07 12:27:08.108987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 402/775] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:27:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:27:08.124214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-42c52cb9-0f6a-4a82-bcc9-80581ebc91c4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:08.125431 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-42c52cb9-0f6a-4a82-bcc9-80581ebc91c4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:08.188006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-42c52cb9-0f6a-4a82-bcc9-80581ebc91c4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:08.195957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-42c52cb9-0f6a-4a82-bcc9-80581ebc91c4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1241 microversion: 2.1 time: 0.077156 Aug 07 12:27:08.196747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 403/776] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:08 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:08.245679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:08.254139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f8fc003d-ebc3-4221-9343-f68f1fbfd051 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.189200 Aug 07 12:27:08.254710 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 374/777] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:08 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:09.042106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:09.042671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:09.049731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.050213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.050647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.051370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.051863 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.059312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.189969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:09.198563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:09.200128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:09.201247 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-56edf47e-7bc5-4c1a-8b81-3bb8004e597f tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.163661 Aug 07 12:27:09.201807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 404/778] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:09 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:09.217232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:09.217846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:09.224564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.225028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.225459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.226150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.226592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.227122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.275795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:09.276413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:09.282477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.282959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.283427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.284126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:09.284573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:09.284997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:09.292759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:09.300386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0e7799d0-4a77-48c6-8e89-40888a1d335f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1245 microversion: 2.1 time: 0.088710 Aug 07 12:27:09.300971 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 375/779] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:09 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:09.429631 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:09.438243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a64eee9a-a26b-4e27-8100-1e891e44d23f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.166537 Aug 07 12:27:09.440952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 405/780] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:09 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:10.224280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:10.224893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:10.232179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.232748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.233199 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.233893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.234346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.234773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.322266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:10.332058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:10.344663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.345159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.345596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.346303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.346760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.347224 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.368908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:10.377746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:10.379219 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:10.380321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0cabc090-0e71-4b9c-b4e1-e453144b4bc4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1408 microversion: 2.20 time: 0.159977 Aug 07 12:27:10.380874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 376/781] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:10 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:10.415345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:10.422765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-72c465a6-a14f-46c8-8d03-c6ec93ab8e47 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1237 microversion: 2.1 time: 0.105217 Aug 07 12:27:10.423410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 406/782] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:10 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:10.460541 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:10.461143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:10.467727 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.468438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.468919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.469781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:10.470229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:10.470649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:10.618444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:10.626456 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5f04543e-9352-478f-8079-2a6df758208f tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1755 microversion: 2.1 time: 0.169719 Aug 07 12:27:10.628766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 377/783] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:10 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:11.403865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.404488 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.410885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.411481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.411923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.412620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.413080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.413508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.443467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.444081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.450669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.451193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.451625 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.452536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.452984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.453401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.457738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:11.516437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:11.524176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ffff6293-cfb8-4ac2-98fd-3f0c0d15f69b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1293 microversion: 2.1 time: 0.084569 Aug 07 12:27:11.525273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 378/784] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:11 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:11.529882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.530373 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.536406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.536890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.537327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.538018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.538473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.538895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.562045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:11.570391 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:11.572547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:11.573733 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-16d071d8-531b-496f-9da1-a163f8510289 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1601 microversion: 2.20 time: 0.174168 Aug 07 12:27:11.574297 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 407/785] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:11 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1601 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:27:11.596686 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.597443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.604489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.604978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.605412 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.606135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.606580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.607029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.632848 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'services' on Instance uuid 8286be07-d68e-431d-9e39-fdc088ca2ec3 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:11.690616 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0160a0a3-f5ff-4ee2-83be-7e068b36aa37 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097756 Aug 07 12:27:11.691371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 408/786] 10.222.0.30 () {60 vars in 1316 bytes} [Sun Aug 7 12:27:11 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:27:11.698940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.698940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.704235 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.704804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.705424 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.706159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.706693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.707324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.848560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-171affaa-6619-4aec-8202-b8c3c8b0710f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments/32da9997-8a3b-4483-ac40-2d906b6bc2e6" status: 202 len: 0 microversion: 2.1 time: 0.322014 Aug 07 12:27:11.849327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 379/787] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:27:11 2022] DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments/32da9997-8a3b-4483-ac40-2d906b6bc2e6 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:11.860970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:11.863902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:11.866146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:11.872557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.873801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.874458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.875589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:11.876208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:11.876741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1489c3fb-2441-40ee-b745-dbc1f6016eb1 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1758 microversion: 2.1 time: 0.183926 Aug 07 12:27:11.876893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:11.877690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 409/788] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:11 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:11.916225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b6b3e8ca-8807-406b-8477-3511f6ae5582 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061075 Aug 07 12:27:11.917069 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 380/789] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:27:11 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:27:12.544596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:12.545203 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:12.548615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:12.552019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:12.552435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:12.552862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:12.553548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:12.553995 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:12.554419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:12.629151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:12.636707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0adc6467-b572-4282-a53d-2c30d5b6ab2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1299 microversion: 2.1 time: 0.095962 Aug 07 12:27:12.637285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 410/790] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:12 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:12.928980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:12.932232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:12.938844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:12.939394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:12.939886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:12.940589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:12.941047 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:12.941470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:12.999809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e5730193-d0d0-4571-801b-68b07322a175 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074865 Aug 07 12:27:13.000989 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 381/791] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:27:12 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:13.106081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:13.130131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:13.130618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:13.131075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:13.149528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] Creating event network-changed:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:27:13.155963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-8e23a5fc-761a-480d-9306-8a00ec0ff862 req-8aa7f4d2-6ec5-4888-8ecf-09aec4af7200 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126786 Aug 07 12:27:13.160615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 411/792] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:13.657617 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:13.658235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:13.664217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:13.665245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:13.665669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:13.666519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:13.667251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:13.667894 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.013594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:14.016544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:14.023445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.024353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.025122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.025801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.026328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.026828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.061877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6d66353f-7a5c-48c2-8381-ee797cad4f68 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053890 Aug 07 12:27:14.063030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 412/793] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:27:14 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 12:27:14.156995 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:14.157408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:14.164516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.165554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.165993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.166678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.167381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.168032 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.187402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:14.194938 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2353ffd8-54e1-494a-80f7-3247e686033b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.541076 Aug 07 12:27:14.195651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 382/794] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:13 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:14.197894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:27:14.480815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ed1b9d53-7aab-4ea5-9f4b-03d0893cae93 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 204 len: 0 microversion: 2.1 time: 0.329971 Aug 07 12:27:14.481448 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 413/795] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:27:14 2022] DELETE /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:27:14.490132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:14.490745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:14.497487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.497982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.498454 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.499191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:14.499645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:14.500069 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:14.719887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:14.728896 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a71a236f-d268-43eb-a981-dbf411b14866 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1691 microversion: 2.1 time: 0.242196 Aug 07 12:27:14.729503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 383/796] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:14 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:15.173129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477dcbef-a34b-4451-b3d6-ae71a4d2e7c8", "tag": "7bb2553d-2953-40cb-955c-2aa311377b30"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:15.183015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:15.183501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:15.183934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:15.194948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] Creating event network-changed:7bb2553d-2953-40cb-955c-2aa311377b30 for instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 on hv-cinder-84984 Aug 07 12:27:15.200363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-7b1b7cd1-2a8a-474c-9531-9b53f679ef1b req-080b6856-75d4-4461-9ff7-524cb52a1ff9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031334 Aug 07 12:27:15.200949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 414/797] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:27:15.217356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:15.217862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:15.224192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:15.224677 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:15.225172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:15.225812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:15.226273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:15.226700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:15.357520 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:15.365070 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c9ec4799-a1da-4be6-9293-0811dda4658d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.152064 Aug 07 12:27:15.365639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 384/798] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:15 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:15.750703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:15.751442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:15.757663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:15.758182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:15.758681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:15.759493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:15.759956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:15.760386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:15.887865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:15.895602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-516e6492-9968-4f36-b3a9-2f46e5ad8511 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1691 microversion: 2.1 time: 0.149375 Aug 07 12:27:15.896166 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 415/799] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:15 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:16.386501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:16.387143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:16.393858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:16.394334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:16.394763 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:16.395458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:16.395900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:16.396314 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:16.522859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:16.531313 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-59991c4c-3f90-4165-a7c9-b9425e5a35ea tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.149324 Aug 07 12:27:16.531893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 385/800] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:16 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:16.916966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:16.917587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:16.923975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:16.924459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:16.924895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:16.925585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:16.926038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:16.926462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:17.053865 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:17.061844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-85780463-01ec-4e37-96b7-79e8406a518a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1691 microversion: 2.1 time: 0.149018 Aug 07 12:27:17.062410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 416/801] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:16 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:17.551836 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:17.552448 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:17.559400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:17.559881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:17.560323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:17.561006 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:17.561457 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:17.561879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:17.691298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:17.699211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-68708dbe-4a56-4090-ad72-90a25caab145 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.151265 Aug 07 12:27:17.699771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 386/802] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:17 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:18.082529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:18.083168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:18.085134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:18.090818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:18.091325 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:18.091785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:18.092473 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:18.092927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:18.093379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:18.191888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=22 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:18.232638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:18.240428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-41f3a34d-7950-4f32-b49c-f578fc617628 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1691 microversion: 2.1 time: 0.161724 Aug 07 12:27:18.241059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 417/803] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:18 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:18.719908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:18.720452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:18.726762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:18.727307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:18.727704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:18.728400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:18.728855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:18.729278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:19.023147 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:19.030729 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-018fa5e2-6ba4-4361-8ff6-e284ff0cc436 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.314806 Aug 07 12:27:19.031338 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 387/804] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:18 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:19.261881 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:19.262606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:19.269573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:19.270138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:19.270701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:19.271455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:19.272009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:19.272511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:19.335704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:19.343633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3404f402-2f1b-4f9e-a6f1-038650a27954 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1624 microversion: 2.1 time: 0.086489 Aug 07 12:27:19.344239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 418/805] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:19 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1624 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:19.471312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8286be07-d68e-431d-9e39-fdc088ca2ec3", "name": "network-vif-deleted", "tag": "2ebaffbe-486a-46fe-80de-ea0e1708cc31"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:19.481432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:19.481983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:19.482411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:19.494098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] Creating event network-vif-deleted:2ebaffbe-486a-46fe-80de-ea0e1708cc31 for instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 on hv-cinder-84984 Aug 07 12:27:19.499384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-7d9d6dfa-110d-49ac-814e-4b2db2b8e4f2 req-ba54d649-d51b-4c14-b38d-0f81f891a96a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031843 Aug 07 12:27:19.499975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 388/806] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:20.051157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:20.051769 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:20.058445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:20.058924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:20.059381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:20.060070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:20.060519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:20.060935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:20.063562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:20.198332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:20.206050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12cd3691-4603-426a-801b-4867812f85a2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.158689 Aug 07 12:27:20.206632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 419/807] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:20 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:20.365227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:20.366315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:20.373415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:20.373899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:20.374339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:20.375144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:20.375593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:20.376018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:20.440929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:20.449829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7a8ae1e1-614c-40c7-8feb-55d707817bce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 200 len: 1331 microversion: 2.1 time: 0.088926 Aug 07 12:27:20.450425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 389/808] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:20 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 1331 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:21.228576 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:21.229190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:21.235798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:21.236285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:21.236712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:21.237410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:21.237859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:21.238280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:21.372076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:21.379441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-683fbd14-594a-42bf-896e-2c9818c435e6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.155316 Aug 07 12:27:21.380015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 420/809] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:21 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:21.470359 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:21.470974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 8286be07-d68e-431d-9e39-fdc088ca2ec3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:21.478028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:21.478507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:21.478950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:21.479676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:21.480129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:21.480551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:21.493719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] HTTP exception thrown: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Request method failure captured: Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 HTTP/1.1 Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765lTiZk3RyAxPFqNVeA7LvzADGnZ-Ru0dBpLB3VVpSGqb47_eCoqOp6eL78s9D_vcfNvmC5mALSLE_R-jcQoq89ns2TjgJd9oLJZ5kO-YG2lFRgBVqindnPWSVHFAmqP9olb_mr1R91bJxTM8nK7XVLCfKJ3Hx5xMSsnuz8R7o6kWM Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:27:21.495371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd31c40f797549d082e083324e285b6e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd31c40f797549d082e083324e285b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 90dc7b751dd14c6f80205e709826423b Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. Aug 07 12:27:21.496858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '8286be07-d68e-431d-9e39-fdc088ca2ec3'} Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:21.497653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. Aug 07 12:27:21.499243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:21.500668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Returning 404 to user: Instance 8286be07-d68e-431d-9e39-fdc088ca2ec3 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:21.500668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f0dfe416-8ab9-4bcf-b0e2-59fba26b716b tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3" status: 404 len: 111 microversion: 2.1 time: 0.030248 Aug 07 12:27:21.500668 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 390/810] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:21 2022] GET /compute/v2.1/servers/8286be07-d68e-431d-9e39-fdc088ca2ec3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:21.505421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-99941afe-59d5-4c55-8754-53891d440e1e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '.version_select at 0x7f7797ec1c10>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:21.580960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-99941afe-59d5-4c55-8754-53891d440e1e tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116993921" status: 202 len: 0 microversion: 2.1 time: 0.079250 Aug 07 12:27:21.581462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 421/811] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 12:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116993921 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:22.400488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:22.401091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:22.406949 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:22.407455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:22.407889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:22.408562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:22.409008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:22.409422 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:22.550484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:22.559423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ce9d3d28-b48c-46c2-a40d-8a2f471d7c48 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.162771 Aug 07 12:27:22.571516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 391/812] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:22 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:23.580884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:23.581833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:23.587488 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:23.588021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:23.588465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:23.589161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:23.589610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:23.590027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:23.725397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:23.732921 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-763ea594-52fa-408b-b1c2-0d682111d0f1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.156569 Aug 07 12:27:23.733491 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 422/813] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:23 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:24.030310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477dcbef-a34b-4451-b3d6-ae71a4d2e7c8", "name": "network-vif-plugged", "status": "completed", "tag": "7bb2553d-2953-40cb-955c-2aa311377b30"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:24.040664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:24.041200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:24.041623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:24.052132 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] Creating event network-vif-plugged:7bb2553d-2953-40cb-955c-2aa311377b30 for instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 on hv-cinder-84984 Aug 07 12:27:24.057653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-4dc306d0-e7d3-41e8-aeb7-8ee83c20cd4c req-2cca3848-62fd-4936-835f-472c6b3e06b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Aug 07 12:27:24.058317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 392/814] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:24.753006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:24.753546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:24.760498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:24.761012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:24.761450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:24.762136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:24.762590 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:24.763040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:24.875235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:24.875817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:24.882058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:24.882557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:24.883679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:24.884427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:24.884887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:24.885344 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:24.891605 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:24.899535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d8cc0491-d4ae-43ed-a9b3-d85fd0115133 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.149847 Aug 07 12:27:24.900110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 423/815] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:24 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:24.910733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:27:25.177438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c41a37cd-8db2-4ce5-ae22-d3126e454f91 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 204 len: 0 microversion: 2.1 time: 0.306129 Aug 07 12:27:25.178079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 393/816] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:27:24 2022] DELETE /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 12:27:25.186494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:25.190427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:25.193089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:25.193582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:25.194021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:25.194715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:25.195192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:25.196160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:25.332668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:25.340075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a6b8e3f2-4b1a-45f7-a383-1aab08b8f7ef tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1508 microversion: 2.1 time: 0.157477 Aug 07 12:27:25.340643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 424/817] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:25 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:25.920213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:25.920916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:25.926888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:25.927403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:25.927837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:25.928521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:25.928970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:25.929392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:25.948054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:26.063408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:26.070849 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2b166159-ed65-425e-a0d1-92d22e743af7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.154651 Aug 07 12:27:26.071434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 394/818] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:25 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:26.363901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:26.364659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:26.371155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:26.371635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:26.372067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:26.372749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:26.373195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:26.373612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:26.501185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:26.509543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-528a840f-8268-4502-9077-5e9b3796a3ce tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1508 microversion: 2.1 time: 0.152521 Aug 07 12:27:26.510111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 425/819] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:26 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:27.091504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:27.092107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:27.098435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:27.098911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:27.099377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:27.100058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:27.100508 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:27.100926 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:27.227473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:27.235516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-669fbcea-56bb-4987-ab85-bb339e0164c1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1366 microversion: 2.1 time: 0.147831 Aug 07 12:27:27.236058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 395/820] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:27 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:27.529818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:27.530429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:27.536766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:27.541277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:27.541277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:27.541277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:27.541277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:27.541667 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:27.674371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:27.682662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-95d86c94-d53d-4411-b388-bcf1c3d1f454 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1508 microversion: 2.1 time: 0.156610 Aug 07 12:27:27.683303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 426/821] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:27 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:28.256248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:28.256853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:28.263636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.264416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.264850 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.265538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.265989 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.266410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.399843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:28.407565 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b97123a9-7112-4fe5-8f4c-4d7778875554 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1557 microversion: 2.1 time: 0.155163 Aug 07 12:27:28.408129 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 396/822] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:28 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:28.428059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:28.428630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:28.434823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.435348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.435781 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.436475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.436928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.437352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.516847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e845d05a-14a0-4623-b53c-a71a31fbbdb7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092686 Aug 07 12:27:28.517462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 427/823] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:27:28 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:28.702903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:28.703609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:28.709384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.709872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.710653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.711665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:28.712267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:28.712838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:28.875950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:28.884552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-15e2203b-f078-454f-8078-0a0d485d4e61 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1508 microversion: 2.1 time: 0.185460 Aug 07 12:27:28.888178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 397/824] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:28 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:28.994013 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13feb920-dba3-4b48-a744-3c293f65c721", "name": "network-vif-deleted", "tag": "12040d1e-600d-44ac-8ea2-ee33856531e1"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:29.004732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:29.005217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:29.005648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:29.018918 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] Creating event network-vif-deleted:12040d1e-600d-44ac-8ea2-ee33856531e1 for instance 13feb920-dba3-4b48-a744-3c293f65c721 on hv-cinder-84984 Aug 07 12:27:29.031325 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-e0d19146-713e-4b4d-ba9c-13ee3998c133 req-219d875a-461e-46ad-9af1-ff2ae95677ac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041975 Aug 07 12:27:29.031934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 428/825] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:29.677320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477dcbef-a34b-4451-b3d6-ae71a4d2e7c8", "tag": "7bb2553d-2953-40cb-955c-2aa311377b30"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:29.687168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:29.687640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:29.688061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:29.699509 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] Creating event network-changed:7bb2553d-2953-40cb-955c-2aa311377b30 for instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 on hv-cinder-84984 Aug 07 12:27:29.704316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-d0359a8c-04b3-4599-a63b-1bb8881da99a req-db8c9d48-fb1c-43cc-a81f-4ce5f15584f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092219 Aug 07 12:27:29.704900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 398/826] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:29.906371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:29.907501 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:29.914368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:29.914949 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:29.915494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:29.916267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:29.916831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:29.917312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:29.951460 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:29.951941 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:29.952378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:29.952821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'fault' on Instance uuid 13feb920-dba3-4b48-a744-3c293f65c721 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:30.017174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:30.025928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-525bad75-f51d-4fe6-941b-6ebf6a2efb46 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 200 len: 1311 microversion: 2.1 time: 0.123967 Aug 07 12:27:30.040010 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 429/827] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:29 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 1311 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:31.049280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:31.049974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 13feb920-dba3-4b48-a744-3c293f65c721] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:31.056056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.056542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.056978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.057664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.058115 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.058538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.071286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] HTTP exception thrown: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Request method failure captured: Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 HTTP/1.1 Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765lTiZk3RyAxPFqNVeA7LvzADGnZ-Ru0dBpLB3VVpSGqb47_eCoqOp6eL78s9D_vcfNvmC5mALSLE_R-jcQoq89ns2TjgJd9oLJZ5kO-YG2lFRgBVqindnPWSVHFAmqP9olb_mr1R91bJxTM8nK7XVLCfKJ3Hx5xMSsnuz8R7o6kWM Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:27:31.072878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd31c40f797549d082e083324e285b6e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd31c40f797549d082e083324e285b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 90dc7b751dd14c6f80205e709826423b Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. Aug 07 12:27:31.074481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '13feb920-dba3-4b48-a744-3c293f65c721'} Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:31.075384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. Aug 07 12:27:31.076816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:31.078087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Returning 404 to user: Instance 13feb920-dba3-4b48-a744-3c293f65c721 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:31.078087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-27879b29-5092-4e12-a007-de28c96d7a53 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721" status: 404 len: 111 microversion: 2.1 time: 0.029682 Aug 07 12:27:31.078087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 399/828] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:31 2022] GET /compute/v2.1/servers/13feb920-dba3-4b48-a744-3c293f65c721 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:31.082765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:31.083284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:31.090132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.090602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.091055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.091739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.092186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.092607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.117944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:27:31.388477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a9858cc6-fb8f-4aae-a663-35bbb19595f4 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "DELETE /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 204 len: 0 microversion: 2.1 time: 0.309237 Aug 07 12:27:31.389315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 430/829] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:27:31 2022] DELETE /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 07 12:27:31.397260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:31.397859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:31.404530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.405003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.405431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.406114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:31.406554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:31.406969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:31.757515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:31.765055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e8fa824e-891f-45e0-85f3-86466bf233f6 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.371680 Aug 07 12:27:31.765611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 400/830] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:31 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:27:32.786713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:32.787448 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:32.793894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:32.794377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:32.794813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:32.795523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:32.795976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:32.796400 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:32.926926 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:32.934977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b8305056-9629-4be2-b08a-7acb4b045f9f tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.152499 Aug 07 12:27:32.935575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 431/831] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:32 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:33.955515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:33.956105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:33.962808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:33.963311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:33.963741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:33.964419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:33.964864 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:33.965283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:34.096540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:34.104955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-53947ab4-c189-42f3-abb3-1bc405dede79 tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1520 microversion: 2.1 time: 0.153219 Aug 07 12:27:34.105536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 401/832] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:33 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:34.662038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "612dc648-62d5-4d0b-9f0a-c5c092085095", "name": "network-vif-deleted", "tag": "bf3e4c47-b32d-4481-987f-3ef87429cf12"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:34.675230 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:34.675713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:34.676149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:34.687241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] Creating event network-vif-deleted:bf3e4c47-b32d-4481-987f-3ef87429cf12 for instance 612dc648-62d5-4d0b-9f0a-c5c092085095 on hv-cinder-84984 Aug 07 12:27:34.692193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-153224b5-68c4-4826-9858-e5b50523ca55 req-33c7accf-5e6d-486d-b0ae-13fd990c8c2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Aug 07 12:27:34.692784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 432/833] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:35.125988 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:35.126593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:35.128651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:35.134948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:35.135453 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:35.135882 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:35.139518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:35.139518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:35.139518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:35.168743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:35.169213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:35.169640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:35.170080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lazy-loading 'fault' on Instance uuid 612dc648-62d5-4d0b-9f0a-c5c092085095 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:35.211506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dc7b751dd14c6f80205e709826423b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd31c40f797549d082e083324e285b6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:27:35.219670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f5e11a5b-0afe-4dd8-8bd6-b4e7177f813a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 200 len: 1310 microversion: 2.1 time: 0.097809 Aug 07 12:27:35.227576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 402/834] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:35 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:27:36.242684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:36.243454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] [instance: 612dc648-62d5-4d0b-9f0a-c5c092085095] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:36.250190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:36.250715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:36.251248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:36.251939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:36.252395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:36.252816 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:36.266786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] HTTP exception thrown: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Request method failure captured: Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 HTTP/1.1 Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765lTiZk3RyAxPFqNVeA7LvzADGnZ-Ru0dBpLB3VVpSGqb47_eCoqOp6eL78s9D_vcfNvmC5mALSLE_R-jcQoq89ns2TjgJd9oLJZ5kO-YG2lFRgBVqindnPWSVHFAmqP9olb_mr1R91bJxTM8nK7XVLCfKJ3Hx5xMSsnuz8R7o6kWM Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:27:36.268563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd31c40f797549d082e083324e285b6e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd31c40f797549d082e083324e285b6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd31c40f797549d082e083324e285b6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: bd31c40f797549d082e083324e285b6e Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1055240598 Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 90dc7b751dd14c6f80205e709826423b Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1055240598-project Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. Aug 07 12:27:36.270150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '612dc648-62d5-4d0b-9f0a-c5c092085095'} Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:36.270994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. Aug 07 12:27:36.272634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:36.273894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] Returning 404 to user: Instance 612dc648-62d5-4d0b-9f0a-c5c092085095 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:36.273894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cca1a597-1391-4e63-a93c-3d49fc17411a tempest-ServerRescueNegativeTestJSON-1055240598 tempest-ServerRescueNegativeTestJSON-1055240598-project] 10.222.0.30 "GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095" status: 404 len: 111 microversion: 2.1 time: 0.032500 Aug 07 12:27:36.273894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 433/835] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:27:36 2022] GET /compute/v2.1/servers/612dc648-62d5-4d0b-9f0a-c5c092085095 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:41.620407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a272efc2-beed-4f3a-b644-6e77a35a2b43 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Action: 'create', calling method: .version_select at 0x7f779759e0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-758248961"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:42.251444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a272efc2-beed-4f3a-b644-6e77a35a2b43 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.744370 Aug 07 12:27:42.252067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 403/836] 10.222.0.30 () {60 vars in 1155 bytes} [Sun Aug 7 12:27:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 746 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 07 12:27:42.264546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-76cb91da-e76c-43b6-b586-435f5c936dd3 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797ec1700>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:42.313641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-76cb91da-e76c-43b6-b586-435f5c936dd3 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 200 len: 344 microversion: 2.1 time: 0.053022 Aug 07 12:27:42.315168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 434/837] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:27:42 2022] GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:43.328521 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6e67df13-2b2c-4a89-a8d0-a2c7d0155b0b tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797540700>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:43.374669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6e67df13-2b2c-4a89-a8d0-a2c7d0155b0b tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 200 len: 345 microversion: 2.1 time: 0.050475 Aug 07 12:27:43.375267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 404/838] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:27:43 2022] GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:43.388101 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b8d41cf4-48d1-49be-9691-d7478cd7cc41 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Action: 'create', calling method: .version_select at 0x7f7797eea670>, body: {"snapshot": {"volume_id": "85481a31-51da-4764-b613-e97b9f6adfeb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1555431506"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:43.800919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b8d41cf4-48d1-49be-9691-d7478cd7cc41 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.417223 Aug 07 12:27:43.801499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 435/839] 10.222.0.30 () {60 vars in 1162 bytes} [Sun Aug 7 12:27:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:43.812639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-eaec5344-8acd-48e6-8cf5-2dd926a98770 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797540790>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:43.843889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-eaec5344-8acd-48e6-8cf5-2dd926a98770 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 287 microversion: 2.1 time: 0.035151 Aug 07 12:27:43.844488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 405/840] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:43 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:43.856062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12c81bbc-f290-42b7-aaa4-00f8d240ee95 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f77a408c0d0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:43.887341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12c81bbc-f290-42b7-aaa4-00f8d240ee95 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035976 Aug 07 12:27:43.887965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 436/841] 10.222.0.30 () {58 vars in 1140 bytes} [Sun Aug 7 12:27:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:43.899839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b6704e09-7a43-4875-b248-d270a49d72cc tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f77975fab80>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:43.931225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b6704e09-7a43-4875-b248-d270a49d72cc tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 287 microversion: 2.1 time: 0.035743 Aug 07 12:27:43.931788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 406/842] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:43 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:44.944182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-89931926-02a5-41a6-8ce3-c259284491a8 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797ec1b80>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:44.973416 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-89931926-02a5-41a6-8ce3-c259284491a8 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 287 microversion: 2.1 time: 0.033522 Aug 07 12:27:44.973967 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 437/843] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:44 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:45.983285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=44 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:45.987194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2cf1770c-83ec-4c25-bfec-bc770e257191 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f77975d0430>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:46.018268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2cf1770c-83ec-4c25-bfec-bc770e257191 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 287 microversion: 2.1 time: 0.036309 Aug 07 12:27:46.018831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 407/844] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:45 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:47.027647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:47.028403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:47.032342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bd376225-5cd4-4408-b39c-0bd378127846 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797f07430>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:47.061827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bd376225-5cd4-4408-b39c-0bd378127846 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 288 microversion: 2.1 time: 0.035434 Aug 07 12:27:47.062394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 438/845] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:47 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:47.074633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dcd60531-bfbb-4862-9a6c-e2a90c871363 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797540ca0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:47.191349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dcd60531-bfbb-4862-9a6c-e2a90c871363 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 202 len: 0 microversion: 2.1 time: 0.121281 Aug 07 12:27:47.198931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 408/846] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Aug 7 12:27:47 2022] DELETE /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:47.201187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ea0c6f6e-ab7b-4ee5-99a1-a1bbb6f27e25 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797e96550>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:47.232036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ea0c6f6e-ab7b-4ee5-99a1-a1bbb6f27e25 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 200 len: 287 microversion: 2.1 time: 0.035222 Aug 07 12:27:47.232631 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 439/847] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:47 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:48.245447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-86c933a7-cdf4-4b54-a0c0-862dbf72dab9 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797751550>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:48.269918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-86c933a7-cdf4-4b54-a0c0-862dbf72dab9 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] HTTP exception thrown: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-86c933a7-cdf4-4b54-a0c0-862dbf72dab9 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Request method failure captured: Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f HTTP/1.1 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi76-9By32w8rLL-lNjkUG3Jq-GU0gkCIN599SZ41fP6Pm1MdX9SaW6cHq4OiszRnS_b3nehM9sAw95sCJ0vK8yPUOtPtB3uiz2XtOHcbgZQYAIeOMtwys8ljTFNN8QoRBkO4PHJ0CkLnu-_vqhtr0bSrk2AqG_pEnixK2Pmo7i1-uh4Y Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:27:48.272143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_367d404c6c9c401f8a21d2acafb02309", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: ca84d98863254aad945864fbc9a5ccf5 Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': 'ddfdec4b-1fe0-456b-bf06-a5e73be1be4f'} Aug 07 12:27:48.273552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. (HTTP 404) (Request-ID: req-aba4366d-a6b1-44dd-a2fe-ab012bf1930a) Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.274421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:48.276543 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 07 12:27:48.278242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-86c933a7-cdf4-4b54-a0c0-862dbf72dab9 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Returning 404 to user: Snapshot ddfdec4b-1fe0-456b-bf06-a5e73be1be4f could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:48.279755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-86c933a7-cdf4-4b54-a0c0-862dbf72dab9 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f" status: 404 len: 111 microversion: 2.1 time: 0.032961 Aug 07 12:27:48.280777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 409/848] 10.222.0.30 () {58 vars in 1251 bytes} [Sun Aug 7 12:27:48 2022] GET /compute/v2.1/os-snapshots/ddfdec4b-1fe0-456b-bf06-a5e73be1be4f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:48.283585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-05930c45-a71b-46ac-927a-2b99c10af8ab tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797f05dc0>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:48.481687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-05930c45-a71b-46ac-927a-2b99c10af8ab tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 202 len: 0 microversion: 2.1 time: 0.202506 Aug 07 12:27:48.482264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 440/849] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:27:48 2022] DELETE /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:48.490320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e4503376-8cba-4e49-b657-6d57ba3bb700 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797540160>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:48.537879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e4503376-8cba-4e49-b657-6d57ba3bb700 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 200 len: 344 microversion: 2.1 time: 0.051263 Aug 07 12:27:48.538438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 410/850] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:27:48 2022] GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:49.552742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6d6f4cbb-fa05-486d-8f8d-b1c9389026ff tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797e96a60>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:49.581285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-6d6f4cbb-fa05-486d-8f8d-b1c9389026ff tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] HTTP exception thrown: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6d6f4cbb-fa05-486d-8f8d-b1c9389026ff tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Request method failure captured: Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb HTTP/1.1 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi76-9By32w8rLL-lNjkUG3Jq-GU0gkCIN599SZ41fP6Pm1MdX9SaW6cHq4OiszRnS_b3nehM9sAw95sCJ0vK8yPUOtPtB3uiz2XtOHcbgZQYAIeOMtwys8ljTFNN8QoRBkO4PHJ0CkLnu-_vqhtr0bSrk2AqG_pEnixK2Pmo7i1-uh4Y Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:27:49.583318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_367d404c6c9c401f8a21d2acafb02309", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: ca84d98863254aad945864fbc9a5ccf5 Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '85481a31-51da-4764-b613-e97b9f6adfeb'} Aug 07 12:27:49.584899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. (HTTP 404) (Request-ID: req-dbc640ad-dc5d-4185-9f92-597f56904dce) Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.585876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:49.587376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 12:27:49.589378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6d6f4cbb-fa05-486d-8f8d-b1c9389026ff tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Returning 404 to user: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6d6f4cbb-fa05-486d-8f8d-b1c9389026ff tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 404 len: 109 microversion: 2.1 time: 0.036530 Aug 07 12:27:49.590895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 441/851] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:27:49 2022] GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:49.599707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d006548-fb55-4c91-9121-f1a5d021dc9c tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f77977510d0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:49.627430 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-5d006548-fb55-4c91-9121-f1a5d021dc9c tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] HTTP exception thrown: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d006548-fb55-4c91-9121-f1a5d021dc9c tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Request method failure captured: Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: DELETE /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb HTTP/1.1 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi76-9By32w8rLL-lNjkUG3Jq-GU0gkCIN599SZ41fP6Pm1MdX9SaW6cHq4OiszRnS_b3nehM9sAw95sCJ0vK8yPUOtPtB3uiz2XtOHcbgZQYAIeOMtwys8ljTFNN8QoRBkO4PHJ0CkLnu-_vqhtr0bSrk2AqG_pEnixK2Pmo7i1-uh4Y Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:27:49.631311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_367d404c6c9c401f8a21d2acafb02309", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: ca84d98863254aad945864fbc9a5ccf5 Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '85481a31-51da-4764-b613-e97b9f6adfeb'} Aug 07 12:27:49.632852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. (HTTP 404) (Request-ID: req-34c2030f-94d6-4f00-9380-4af6e1c8bd2c) Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.634310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 07 12:27:49.636048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 07 12:27:49.637514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d006548-fb55-4c91-9121-f1a5d021dc9c tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Returning 404 to user: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5d006548-fb55-4c91-9121-f1a5d021dc9c tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 404 len: 109 microversion: 2.1 time: 0.035420 Aug 07 12:27:49.639211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 411/852] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:27:49 2022] DELETE /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:49.640955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2c2d85d-bd63-483f-bf6a-cf5c188cad03 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Calling method '.version_select at 0x7f7797e96e50>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:49.668492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-b2c2d85d-bd63-483f-bf6a-cf5c188cad03 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] HTTP exception thrown: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2c2d85d-bd63-483f-bf6a-cf5c188cad03 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Request method failure captured: Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb HTTP/1.1 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi76-9By32w8rLL-lNjkUG3Jq-GU0gkCIN599SZ41fP6Pm1MdX9SaW6cHq4OiszRnS_b3nehM9sAw95sCJ0vK8yPUOtPtB3uiz2XtOHcbgZQYAIeOMtwys8ljTFNN8QoRBkO4PHJ0CkLnu-_vqhtr0bSrk2AqG_pEnixK2Pmo7i1-uh4Y Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:27:49.670406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_367d404c6c9c401f8a21d2acafb02309", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/367d404c6c9c401f8a21d2acafb02309"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 367d404c6c9c401f8a21d2acafb02309 Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2113341200 Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: ca84d98863254aad945864fbc9a5ccf5 Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2113341200-project Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '85481a31-51da-4764-b613-e97b9f6adfeb'} Aug 07 12:27:49.672175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. (HTTP 404) (Request-ID: req-fa67d14b-89a9-46ab-9158-ce84f6671051) Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.673131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 07 12:27:49.674549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 07 12:27:49.676137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b2c2d85d-bd63-483f-bf6a-cf5c188cad03 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] Returning 404 to user: Volume 85481a31-51da-4764-b613-e97b9f6adfeb could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b2c2d85d-bd63-483f-bf6a-cf5c188cad03 tempest-VolumesSnapshotsTestJSON-2113341200 tempest-VolumesSnapshotsTestJSON-2113341200-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb" status: 404 len: 109 microversion: 2.1 time: 0.035640 Aug 07 12:27:49.677548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 442/853] 10.222.0.30 () {58 vars in 1245 bytes} [Sun Aug 7 12:27:49 2022] GET /compute/v2.1/os-volumes/85481a31-51da-4764-b613-e97b9f6adfeb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:27:54.607778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:27:54.613441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-251659548"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:54.613972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:54.620640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:54.621120 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:54.621545 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:54.622232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:54.622740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:54.623192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:54.901095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.network.security_group_api [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Removing security group f52ab156-6eff-4381-81ad-0cb7d4dc8077 from port 0c677232-63cc-4a24-9def-bf711bd3f6f7 Aug 07 12:27:55.755333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d9b9dab5-97e8-4235-96ba-38c673a4e0df tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action" status: 202 len: 0 microversion: 2.1 time: 1.149162 Aug 07 12:27:55.759345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 412/854] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:27:54 2022] POST /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/action => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:55.770030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:55.782766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:55.783527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:55.784142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:55.797950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] Creating event network-changed:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:27:55.804648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-bbfd7ab2-0017-459f-9fe6-64c675d5ba08 req-8dc75990-ba66-4a16-a4fa-f9cb378d315c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039911 Aug 07 12:27:55.805868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 443/855] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:56.767097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:56.767645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:56.774513 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:56.775404 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:56.776174 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:56.777410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:56.777858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:56.778297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:56.962804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-03f44a77-a1aa-4139-aa27-3768a2446bd1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/ips" status: 200 len: 153 microversion: 2.20 time: 0.200006 Aug 07 12:27:56.965653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 413/856] 10.222.0.30 () {60 vars in 1289 bytes} [Sun Aug 7 12:27:56 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/ips => generated 153 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 07 12:27:57.574460 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:57.576214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:57.580836 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:57.584467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:57.585170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:57.585821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:57.587258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:57.588164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:57.588915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:57.597629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:57.599295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:57.599295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:57.623723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] Creating event network-changed:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:27:57.632972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-a343f665-76e8-45d9-a3f8-bf0ff4b51918 req-bc58722d-f3f4-4c8e-8bb7-c77a6f7252a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055889 Aug 07 12:27:57.636966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 414/857] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:27:57.703100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lazy-loading 'services' on Instance uuid b9f9c8e1-e51b-422c-afa4-84116b5fac18 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:57.929789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f4683e00-f973-41d5-91a1-39c3440ad60a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments/e832a77a-837d-4fd3-8bae-1e7e887a9dc7" status: 202 len: 0 microversion: 2.1 time: 0.361882 Aug 07 12:27:57.945622 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 444/858] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:27:57 2022] DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments/e832a77a-837d-4fd3-8bae-1e7e887a9dc7 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:27:57.946987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:57.951125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:57.959859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:57.960538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:57.962071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:57.963161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:57.963610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:57.964190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:58.001623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2276021a-3ec5-4f70-99d3-31de06a41852 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065223 Aug 07 12:27:58.002876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 415/859] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:27:57 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:59.015457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:59.018253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:59.025877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.026414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.026840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:59.027557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.028008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.031107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:59.057259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-707d354d-03e8-4716-b600-03820fa5bf6a tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 Aug 07 12:27:59.059707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 445/860] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:27:59 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:27:59.254972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:27:59.255595 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:59.262634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.263155 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.263609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:59.264949 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.265596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.266026 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:59.289423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lazy-loading 'flavor' on Instance uuid 801b2a50-c582-4736-b142-a14efe56020a {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:27:59.820409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b85a0f59-cc8e-4736-9735-8e86678cdc38 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/action" status: 202 len: 0 microversion: 2.20 time: 0.569373 Aug 07 12:27:59.821726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 416/861] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 12:27:59 2022] POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:27:59.830601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:27:59.831657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:27:59.844926 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.845289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.845729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:27:59.846432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:27:59.846883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:27:59.847340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:00.001289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:00.010195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:00.012838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:00.014274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0fb85cf0-2b10-4d0f-bdde-f38c91ca2f57 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.187989 Aug 07 12:28:00.014845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 446/862] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:27:59 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:00.071260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:00.073588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:00.080630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:00.081183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:00.081755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:00.082438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:00.082950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:00.083460 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:00.112672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e1f830ee-097b-4478-a3e2-4ae3dc084bad tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046435 Aug 07 12:28:00.113473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 417/863] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:00 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:28:00.125629 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:00.129219 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:00.133067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:00.134012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:00.134455 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:00.135233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:00.135697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:00.136129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:00.224237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] HTTP exception thrown: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 is not attached to volume e832a77a-837d-4fd3-8bae-1e7e887a9dc7 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Request method failure captured: Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments/e832a77a-837d-4fd3-8bae-1e7e887a9dc7 HTTP/1.1 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7675up4csHeKlG9RlmVI8MCobizhlKlSssZKthfiomvuxE7C9tD7T1yOdXtI1gLZMCoj6xhRLjjgrgdNT8e2xHlf1IoE-EUdIgW2G8VBR1IaBLnp4p-0YHCHFwcWTb1o9UwRpEv3dq-JGEWglkzn3xm3RWxDs_dtLVQ3rSoFVammFjc Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 006bf6eb97a14d8c8c33f880b0bb80bc Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:28:00.233381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_006bf6eb97a14d8c8c33f880b0bb80bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 006bf6eb97a14d8c8c33f880b0bb80bc Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-TestMinimumBasicScenario-1181257574-project Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c62c3bfffc214c57a1f48b2779a615ac Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-TestMinimumBasicScenario-1181257574-project Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:28:00.235067 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 is not attached to volume e832a77a-837d-4fd3-8bae-1e7e887a9dc7 Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'server_id': 'b9f9c8e1-e51b-422c-afa4-84116b5fac18', 'id': 'e832a77a-837d-4fd3-8bae-1e7e887a9dc7'} Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e832a77a-837d-4fd3-8bae-1e7e887a9dc7. Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:28:00.235948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 is not attached to volume e832a77a-837d-4fd3-8bae-1e7e887a9dc7 Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 is not attached to volume e832a77a-837d-4fd3-8bae-1e7e887a9dc7 Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:00.237638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Returning 404 to user: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 is not attached to volume e832a77a-837d-4fd3-8bae-1e7e887a9dc7 {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:28:00.239234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1f81a3bf-9bdc-4b3e-af77-746c8e794c49 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments/e832a77a-837d-4fd3-8bae-1e7e887a9dc7" status: 404 len: 154 microversion: 2.1 time: 0.114182 Aug 07 12:28:00.239234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 447/864] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:28:00 2022] DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18/os-volume_attachments/e832a77a-837d-4fd3-8bae-1e7e887a9dc7 => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:28:01.036804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:01.037401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:01.044662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.045152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.045587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:01.046280 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.046732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.047189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:01.187326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:01.195540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:01.197466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:01.198640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a511b198-9fba-4b29-9845-8854c046fb64 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.165688 Aug 07 12:28:01.199220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 418/865] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:01 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:01.557634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:01.558162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:01.564472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.564953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.565383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:01.566065 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.566538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.566939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:01.594943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:28:01.850721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a678a78b-9cb3-4043-836b-0344600f2a8e tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 204 len: 0 microversion: 2.1 time: 0.296674 Aug 07 12:28:01.851365 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 448/866] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:28:01 2022] DELETE /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:28:01.860420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:01.861023 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:01.867052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.868096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.868560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:01.869235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:01.869685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:01.870101 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:02.058750 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:02.066270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-428d0f08-8d15-4dcf-9b21-25d2f2facee0 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1554 microversion: 2.1 time: 0.210075 Aug 07 12:28:02.066832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 419/867] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:01 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:02.225324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:02.225324 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:02.230831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:02.231384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:02.231829 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:02.232531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:02.232988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:02.233406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:02.364152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:02.372690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:02.374399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:02.375582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1376acb2-42ba-4758-b7e7-eda9f00bbc36 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.157580 Aug 07 12:28:02.376134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 449/868] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:02 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:03.089660 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:03.090273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:03.096820 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:03.097329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:03.097765 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:03.098464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:03.098919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:03.099372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:03.288972 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:03.296718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bcdf70f6-3950-40b8-80ef-acb387f7f890 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1554 microversion: 2.1 time: 0.211759 Aug 07 12:28:03.297286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 420/869] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:03 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:03.399423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:03.400112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:03.406975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:03.407366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:03.407804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:03.408502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:03.408957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:03.409385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:03.555447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:03.563392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:03.564903 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:03.566071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2732fdd6-2bf4-4e60-a621-d0a3d17e62f4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.171153 Aug 07 12:28:03.566637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 450/870] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:03 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:04.318192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:04.318819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:04.325841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:04.326327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:04.326764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:04.327506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:04.327961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:04.328442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:04.508403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:04.521951 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cfc50841-f744-41de-88c1-d6ad138e4194 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1554 microversion: 2.1 time: 0.207579 Aug 07 12:28:04.524427 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 421/871] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:04 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:04.569303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f9c8e1-e51b-422c-afa4-84116b5fac18", "name": "network-vif-deleted", "tag": "0c677232-63cc-4a24-9def-bf711bd3f6f7"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:04.580293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:04.580857 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:04.581987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:04.590050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:04.590947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:04.593952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] Creating event network-vif-deleted:0c677232-63cc-4a24-9def-bf711bd3f6f7 for instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 on hv-cinder-84984 Aug 07 12:28:04.598231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:04.598978 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:04.599191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-fb7af1c6-c439-446a-9de5-b1857e727af7 req-678aeefc-c3bd-4206-8126-692ada156a3a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033732 Aug 07 12:28:04.599805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:04.600170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 451/872] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:04.600708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:04.601207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:04.601571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:04.748347 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:04.756401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:04.757915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:04.759189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5d40fe2c-793f-48e1-b7cf-cda5ac87ad99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.173311 Aug 07 12:28:04.760260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 422/873] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:04 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:05.545665 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:05.546399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:05.552718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:05.553209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:05.553647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:05.554342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:05.554847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:05.557536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:05.588591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:05.589700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:05.590277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:05.590591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lazy-loading 'fault' on Instance uuid b9f9c8e1-e51b-422c-afa4-84116b5fac18 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:28:05.650168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c62c3bfffc214c57a1f48b2779a615ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006bf6eb97a14d8c8c33f880b0bb80bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:05.657924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a9c13aec-e2d5-4f23-89d9-00dd462ea2f3 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 200 len: 1349 microversion: 2.1 time: 0.116705 Aug 07 12:28:05.658500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 452/874] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:05 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 1349 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:05.783735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:05.784337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:05.791425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:05.791914 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:05.792348 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:05.796999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:05.796999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:05.796999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:05.926702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:05.935289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:05.936813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:05.938068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9e07e21b-f313-4b24-8f1b-55d30d3721cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.158275 Aug 07 12:28:05.938625 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 423/875] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:05 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:06.679742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:06.680366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] [instance: b9f9c8e1-e51b-422c-afa4-84116b5fac18] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:06.687080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:06.687601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:06.688043 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:06.688761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:06.689226 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:06.689651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:06.704137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] HTTP exception thrown: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Request method failure captured: Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 HTTP/1.1 Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7675up4csHeKlG9RlmVI8MCobizhlKlSssZKthfiomvuxE7C9tD7T1yOdXtI1gLZMCoj6xhRLjjgrgdNT8e2xHlf1IoE-EUdIgW2G8VBR1IaBLnp4p-0YHCHFwcWTb1o9UwRpEv3dq-JGEWglkzn3xm3RWxDs_dtLVQ3rSoFVammFjc Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 006bf6eb97a14d8c8c33f880b0bb80bc Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:28:06.705817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_006bf6eb97a14d8c8c33f880b0bb80bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/006bf6eb97a14d8c8c33f880b0bb80bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 006bf6eb97a14d8c8c33f880b0bb80bc Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1181257574 Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-TestMinimumBasicScenario-1181257574-project Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c62c3bfffc214c57a1f48b2779a615ac Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-TestMinimumBasicScenario-1181257574-project Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. Aug 07 12:28:06.707467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'b9f9c8e1-e51b-422c-afa4-84116b5fac18'} Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:28:06.708403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. Aug 07 12:28:06.710036 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:06.712188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Returning 404 to user: Instance b9f9c8e1-e51b-422c-afa4-84116b5fac18 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:28:06.712188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d5f52be5-0e08-41eb-af87-eaac9446ead2 tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18" status: 404 len: 111 microversion: 2.1 time: 0.031428 Aug 07 12:28:06.712188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 453/876] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:06 2022] GET /compute/v2.1/servers/b9f9c8e1-e51b-422c-afa4-84116b5fac18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:28:06.717323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-31880df3-5db9-43eb-8cd6-2c753866b3dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] Calling method '.version_select at 0x7f77975401f0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:06.794408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-31880df3-5db9-43eb-8cd6-2c753866b3dd tempest-TestMinimumBasicScenario-1181257574 tempest-TestMinimumBasicScenario-1181257574-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215802531" status: 202 len: 0 microversion: 2.1 time: 0.082229 Aug 07 12:28:06.795998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 424/877] 10.222.0.30 () {58 vars in 1272 bytes} [Sun Aug 7 12:28:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1215802531 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:28:06.961877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:06.962482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:06.969178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:06.969656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:06.970091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:06.970770 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:06.971248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:06.971831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:07.104767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:07.113116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:07.114621 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:07.116264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1524c3a3-6cb8-4484-9090-6dba67c3bfd5 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.158503 Aug 07 12:28:07.116997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 454/878] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:06 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:08.140574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:08.141340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:08.148315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:08.148891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:08.149444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:08.150152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:08.150608 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:08.151614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:08.293429 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:08.302261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:08.304312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:08.305499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9935a348-18ee-4c4e-adf1-5b8b95eca2bc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.170541 Aug 07 12:28:08.306319 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 425/879] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:08 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:09.329680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:09.330301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:09.342810 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:09.344231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:09.344231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:09.345624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:09.346167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:09.347284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:09.565261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:09.574161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:09.575979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:09.577738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9384d74a-e988-499a-a081-888d38dfa996 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.252212 Aug 07 12:28:09.578326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 455/880] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:09 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:10.601415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:10.602109 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:10.609492 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:10.609975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:10.610406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:10.611119 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:10.611579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:10.611990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:10.784208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:10.794408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:10.796150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:10.797351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2cf6360c-10f0-4bef-853f-5101a4d998d0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.199900 Aug 07 12:28:10.797939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 426/881] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:10 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:11.821490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:11.825474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:11.828503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:11.828984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:11.829515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:11.830199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:11.830660 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:11.831208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:11.981474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:11.989598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:11.991250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:11.992363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f90ad119-d46e-47b7-a941-16ae447f61ab tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.174644 Aug 07 12:28:11.998868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 456/882] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:11 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:13.019927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:13.020664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:13.027538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:13.028016 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:13.028449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:13.029135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:13.029586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:13.030004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:13.193759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:13.202339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:13.203994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:13.205226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-699f09da-72c3-43ae-8ca3-108756090909 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.189277 Aug 07 12:28:13.205784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 427/883] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:13 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:13.435913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:13.436443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:13.443451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:13.443944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:13.444432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:13.445325 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:13.445780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:13.446203 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:13.470211 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7c823c71-d2ed-47a9-b343-e06224bd6053 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/ips" status: 200 len: 151 microversion: 2.1 time: 0.038871 Aug 07 12:28:13.471499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 457/884] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:28:13 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:14.228161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:14.229295 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:14.236170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:14.236667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:14.237099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:14.237982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:14.238437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:14.238868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:14.461507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:14.465250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:14.470144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:14.471649 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:14.472801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8b5e7118-7cfd-43ff-9d17-4d6468f7e1c0 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.248715 Aug 07 12:28:14.473350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 428/885] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:14 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:15.137164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14aa65c3-ef7b-40aa-81af-96c21b705b51"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:15.141315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:15.149632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:15.150167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:15.151251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:15.151940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:15.152586 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:15.153000 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:15.369708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:15.496176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:15.496783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:15.503640 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:15.504122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:15.504556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:15.505279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:15.505726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:15.506145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:15.753879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:15.762601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:15.764684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:15.766372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-43259e5a-2610-4beb-b344-acadf790e5b7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.274654 Aug 07 12:28:15.767052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 429/886] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:15 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:16.075610 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fb5de411-2f16-449f-b41a-bb308d21056a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.941616 Aug 07 12:28:16.076250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 458/887] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:28:15 2022] POST /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:16.790959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:16.792532 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:16.799179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:16.799663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:16.800102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:16.800789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:16.801243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:16.801667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:16.934774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:16.942878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:16.944448 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:16.945600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f4bab34e-e8b3-482a-93a8-4931bce0dcca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.158922 Aug 07 12:28:16.946156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 430/888] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:16 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:17.970041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:17.970821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:17.977045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:17.977625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:17.978061 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:17.978905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:17.979397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:17.979825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:18.119059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:18.128748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:18.136449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:18.136449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-205c2832-f21d-4ffc-8e97-9b8ae429fc42 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.166935 Aug 07 12:28:18.136449 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 459/889] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:17 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:19.157861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:19.158464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:19.164818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:19.165304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:19.165742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:19.166431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:19.166888 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:19.167341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:19.304323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:19.311451 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:19.312940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:19.314143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9581861f-8a63-40e6-aeab-06104cee4133 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.160252 Aug 07 12:28:19.314694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 431/890] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:19 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:20.337479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:20.338083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:20.340693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:20.345323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:20.345805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:20.346232 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:20.346914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:20.347385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:20.347807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:20.477476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:20.485547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:20.488183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:20.488315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0e4ffa38-26dc-4818-8312-8d0d988def8d tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.154695 Aug 07 12:28:20.488814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 460/891] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:20 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:21.511380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:21.512029 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:21.518632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:21.519137 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:21.519571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:21.520253 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:21.520700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:21.521121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:21.650212 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:21.658209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:21.659726 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:21.660874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-49afd5c0-6b4a-41f1-9fb3-3ea6ee415a99 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1747 microversion: 2.20 time: 0.153389 Aug 07 12:28:21.661431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 432/892] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:21 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:22.686270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:22.687125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:22.693414 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:22.693892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:22.694323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:22.695392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:22.695852 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:22.696901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:22.826912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:22.834957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:22.836497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:22.837683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2ff2c497-e419-41e3-b6bf-504de4d0a775 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1747 microversion: 2.20 time: 0.156894 Aug 07 12:28:22.838228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 461/893] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:22 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:23.860611 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:23.861222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:23.867825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:23.871816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:23.871816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:23.871816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:23.871816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:23.872266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:24.002720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:24.010528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:24.012650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:24.014059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b33687bc-2e49-41cb-8c0b-b1cbb313fc84 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1747 microversion: 2.20 time: 0.157131 Aug 07 12:28:24.014613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 433/894] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:23 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:24.499853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "name": "network-vif-plugged", "status": "completed", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:24.509476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:24.510185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:24.510429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:24.524926 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] Creating event network-vif-plugged:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:28:24.530419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-dc7dc626-97f2-4a67-979b-8ba49ba96473 req-0c6c4222-8ac1-4a27-9d8e-2234586ba6e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226975 Aug 07 12:28:24.533969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 462/895] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:24.874944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14aa65c3-ef7b-40aa-81af-96c21b705b51"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:24.877442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:24.879866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:24.884474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:24.884952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:24.885394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:24.886076 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:24.886623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:24.887334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:24.970372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: POST /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments HTTP/1.1 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 74 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:28:24.972075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {"volumeAttachment": {"volumeId": "14aa65c3-ef7b-40aa-81af-96c21b705b51"}} Aug 07 12:28:24.973852 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'server_id': '477dcbef-a34b-4451-b3d6-ae71a4d2e7c8', 'body': {'volumeAttachment': {'volumeId': '14aa65c3-ef7b-40aa-81af-96c21b705b51'}}} Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:28:24.974945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:24.979923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 400 to user: Invalid volume: volume 14aa65c3-ef7b-40aa-81af-96c21b705b51 is already attached to instances: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f63c2a76-07b0-4ab7-a3ce-e6291ee715c0 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102860 Aug 07 12:28:24.982804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 434/896] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:28:24 2022] POST /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:28:25.038291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:25.038961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:25.039121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:25.039473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:25.046304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.046750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.046909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.047236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.047361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.047704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.047916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.048409 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.048534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.048869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.049015 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.049299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.145084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'services' on Instance uuid 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:28:25.203033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:25.219575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:25.227304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:25.227304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12889007-19b7-4cf5-bb2d-014c3d3cd22e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.188786 Aug 07 12:28:25.227304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 463/897] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:25 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:25.411994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b4a417a9-6544-40cb-a62b-9fd07c572a9a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments/14aa65c3-ef7b-40aa-81af-96c21b705b51" status: 202 len: 0 microversion: 2.1 time: 0.376635 Aug 07 12:28:25.423076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:25.425600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:25.427632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 435/898] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:28:25 2022] DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments/14aa65c3-ef7b-40aa-81af-96c21b705b51 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:28:25.434205 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.434851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.435641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.436577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:25.437197 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:25.437813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:25.470653 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-80993004-ea0a-4544-92cf-57abcad0b22b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052788 Aug 07 12:28:25.471570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 464/899] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:25 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:26.246787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:26.248250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:26.255945 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:26.256737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:26.257388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:26.258282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:26.258809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:26.259335 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:26.416293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:26.428546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:26.430369 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:26.431846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b58486b8-1fab-48c4-b77e-3365825cbbce tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.189658 Aug 07 12:28:26.432476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 436/900] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:26 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:26.486656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:26.489731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:26.496264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:26.497170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:26.497797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:26.498709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:26.499193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:26.499786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:26.532165 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-37eed1c3-02a7-4484-a505-2738b598831b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050557 Aug 07 12:28:26.532738 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 465/901] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:26 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:27.457710 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:27.458775 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:27.465361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:27.468024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:27.468024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:27.468024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:27.468024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:27.468878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:27.545946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:27.549165 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:27.561921 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:27.562820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:27.563526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:27.564496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:27.565205 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:27.565887 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:27.623491 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6618de8f-8133-4efd-b496-3776c1fcdeb3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081567 Aug 07 12:28:27.625164 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 466/902] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:27 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:27.675213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:27.681536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:27.683947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:27.685653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9edfa0a6-6dae-4a4c-aa61-5ee5cc4645a6 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.232140 Aug 07 12:28:27.695444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 437/903] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:27 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:28.637762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:28.640630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:28.647463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:28.648056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:28.648602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:28.649371 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:28.649890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:28.650401 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:28.686508 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ff773133-f4c5-4281-b7fa-8a281fe85d51 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053153 Aug 07 12:28:28.687680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 467/904] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:28 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:28.709290 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:28.710002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:28.719574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:28.720244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:28.720749 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:28.721680 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:28.722200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:28.722690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:28.870364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:28.879486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:28.881362 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:28.882714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3740f59c-6304-44e8-ae16-52da63e65a46 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.177623 Aug 07 12:28:28.895560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 438/905] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:28 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:29.702451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:29.704879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:29.711768 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:29.712562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:29.713291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:29.714220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:29.715107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:29.716122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:29.760489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c1b33bff-b4cd-460d-af5a-93cf85488361 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064239 Aug 07 12:28:29.764285 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 468/906] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:29 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:29.910083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:29.910673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:29.921397 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:29.922294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:29.930181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:29.931107 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:29.931821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:29.932316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:30.421874 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:30.430080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:30.432507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:30.438220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0badbf2e-7741-42aa-9dc2-1f5d1771a930 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.531431 Aug 07 12:28:30.459050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 439/907] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:29 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:30.774172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:30.776316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:30.784064 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:30.784775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:30.787747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:30.787747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:30.787747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:30.787747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:30.821306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6bed3711-f245-4c3a-b9ed-17b2d91e2102 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051526 Aug 07 12:28:30.827291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 469/908] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:30 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:31.285130 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:31.292090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:31.293224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:31.302536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.303088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.303563 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.306095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.306613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.307113 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.307929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.309375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.309865 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.319625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] Creating event network-changed:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:28:31.324964 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-dfec74b0-9d70-4a48-8f90-a245e51aa2f1 req-163d74d9-61b8-4b79-8590-0bddc3562022 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043838 Aug 07 12:28:31.325648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 470/909] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:31.343738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:28:31.467063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:31.468051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:31.474441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.474931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.475483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.476186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.476673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.477188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.626355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:31.636898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:31.639616 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:31.641295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5880b82e-0b6b-48b1-90b1-fe839c934766 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.179672 Aug 07 12:28:31.642051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 471/910] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:31 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:31.692395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8d8e8137-27bf-4493-ba55-19d470828a4e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 204 len: 0 microversion: 2.1 time: 0.415971 Aug 07 12:28:31.693411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 440/911] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:28:31 2022] DELETE /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:28:31.704019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:31.704638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:31.711261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.711757 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.712261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.712962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.713417 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.714069 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.834741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:31.837678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:31.853675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.854331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.857234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.857234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:31.859308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:31.859764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:31.904881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-efdf24c7-f25f-4ece-be2e-d525ce4a9d0e tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074754 Aug 07 12:28:31.905919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 441/912] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:31 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:31.913284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:31.925850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a49d0545-c28c-488f-a38c-041c6c4e0285 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.225495 Aug 07 12:28:31.929136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 472/913] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:31 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:32.666044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:32.666631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:32.674388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.674952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.676019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.676740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.677331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.677750 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.833065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:32.842213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:32.843924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:32.845109 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ff5c7d75-ee7a-4ef5-a9af-f47769cf605c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.183091 Aug 07 12:28:32.845673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 442/914] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:32 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:32.918408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:32.920870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:32.927979 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.928774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.929378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.930282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.930891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.931486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.950633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:32.951293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:32.957264 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.957751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.958192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.958886 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:32.959551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:32.959789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:32.965693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a9f74e7d-165b-4fff-a7a7-2c95480309d3 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052115 Aug 07 12:28:32.967049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:32.968045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 473/915] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:32 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:33.129567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:33.140426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b61d836a-4d77-475c-89d1-9193b8959d5c tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.194320 Aug 07 12:28:33.145353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 443/916] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:32 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:33.868833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:33.869963 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:33.877246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:33.877853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:33.878362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:33.879173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:33.879688 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:33.880307 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:33.979428 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:33.983229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:33.991762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:33.992358 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:33.992876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:33.993745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:33.994274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:33.994773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:34.028497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:34.035170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f1700f94-c9e4-44c7-81d2-21c86257c2d1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059805 Aug 07 12:28:34.040145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 444/917] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:33 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:34.041482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:34.044160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:34.045706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e79f0962-0a1a-4d64-ad38-287720785f29 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.180683 Aug 07 12:28:34.046467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 474/918] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:33 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:34.161968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:34.162577 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:34.170585 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:34.171104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:34.171540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:34.172242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:34.172692 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:34.173108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:34.320884 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:34.329996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e3064d2f-8119-4cd6-bfbf-c5c88f4476e3 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.171991 Aug 07 12:28:34.330580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 445/919] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:34 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:35.048031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:35.050524 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:35.057309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.058175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.058620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.059513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.060137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.060643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.074921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:35.075530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:35.092003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.092498 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.092932 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.093638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.094117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.094540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.110652 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:35.116442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4d609a53-a6d6-43dd-8bca-8ee5910fc627 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072633 Aug 07 12:28:35.117229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 475/920] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:35 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:35.255041 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:35.264338 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:35.266288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:35.269764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a2f560f5-66fc-4a98-a4a7-dcbe43b455bd tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.200161 Aug 07 12:28:35.284931 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 446/921] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:35 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:35.351663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:35.352514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:35.360055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.360546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.361005 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.361709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:35.364712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:35.365363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:35.512072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:35.521246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-250e6b31-8686-4363-bad3-ba60188afb0e tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.174063 Aug 07 12:28:35.521821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 476/922] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:35 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:36.128743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:36.130878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:36.137934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.138407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.139116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.139795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.140237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.140655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.168781 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c8fa9163-eb79-4dc5-8002-6374a92a4207 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Aug 07 12:28:36.169330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 447/923] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:36 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:36.292717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:36.293228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:36.299649 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.300137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.300573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.301262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.301716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.302143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.434132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:36.442112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:36.443634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:36.444787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2f640256-e8b2-4f46-8373-46ed39275f0c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.156104 Aug 07 12:28:36.445351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 477/924] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:36 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:36.542503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:36.543695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:36.549810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.550285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.550714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.551424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:36.551872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:36.552288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:36.686382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:36.693812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bf701d4b-bc72-4df6-9090-7e10bbbd519f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.155204 Aug 07 12:28:36.694370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 448/925] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:36 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:37.180854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:37.183023 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:37.189029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.189513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.189955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.190648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.191137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.191566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.221394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9c935ddf-75de-4c8e-83ae-a8b3c305d5d9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Aug 07 12:28:37.221959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 478/926] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:37 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:37.469140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:37.469766 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:37.476300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.476777 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.477241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.477925 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.478375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.478932 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.611364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:37.619221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:37.621821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:37.623122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-34396bd7-d57c-4ccd-b735-1df4903ab004 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.158728 Aug 07 12:28:37.623690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 449/927] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:37 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:37.714904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:37.715559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:37.722084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.722507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.722947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.723657 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:37.724116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:37.724535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:37.854966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:37.862894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9ad499ce-bfec-41a4-84a0-7085647c2d7f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.152108 Aug 07 12:28:37.863485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 479/928] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:37 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:38.233333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:38.235571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:38.241490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.241985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.242406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:38.243116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.246614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.246614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:38.272984 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e02543e6-8154-45c4-bd81-38bfc99d9e8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 07 12:28:38.273539 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 450/929] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:38 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:38.646840 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:38.647517 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:38.654030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.654514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.655322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:38.656030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.656479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.656898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:38.789578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:38.797631 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:38.799199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:38.800372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-292d2c8c-3b61-4537-8c4c-589e49010433 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.157523 Aug 07 12:28:38.800933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 480/930] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:38 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:38.884729 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:38.885452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:38.892755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.893236 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.893666 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:38.894351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:38.894800 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:38.895277 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:39.032256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:39.040228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3236712e-9597-46e0-a4e0-a4e6fa2009af tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.159362 Aug 07 12:28:39.040824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 451/931] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:38 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:39.286426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:39.446494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:39.446494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:39.446494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:39.446494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:39.446972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:39.446972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:39.446972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:39.446972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-85d3c8e7-88a8-4469-b0bf-ffc272766de6 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 Aug 07 12:28:39.447353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 481/932] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:39 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:39.823744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:39.824305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:39.830279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:39.830757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:39.831273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:39.831937 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:39.832381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:39.832801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:40.018325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:40.026742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:40.028375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:40.029574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-331fb985-a8d0-4a6c-be23-7994336c7198 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1742 microversion: 2.20 time: 0.209945 Aug 07 12:28:40.030140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 452/933] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:39 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:40.061521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:40.062129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:40.068411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:40.068882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:40.069310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:40.069986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:40.070432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:40.070851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:40.210695 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:40.219321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9e87f12d-d39f-4277-bce1-9d655b21dca5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.161537 Aug 07 12:28:40.223777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 482/934] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:40 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:40.341757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:40.343981 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:40.349999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:40.350486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:40.350932 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:40.351671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:40.352127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:40.352552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:40.383300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6ed62423-9a6d-43b8-9f93-60fd4a462176 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Aug 07 12:28:40.383867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 453/935] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:40 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:41.053046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:41.053652 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:41.059708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.060193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.060621 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.061303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.061752 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.062300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.193348 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:41.201744 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:41.204269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:41.204416 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c5b31053-d595-48e3-bef6-dafc42b909cc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.155343 Aug 07 12:28:41.204942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 483/936] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:41 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:41.240979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:41.241620 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:41.248171 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.248659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.249099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.249792 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.250339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.250767 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.389375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:41.394946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:41.396787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c6e340c0-0ff9-48ac-98f9-b958226b5149 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.159846 Aug 07 12:28:41.397147 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:41.397349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 454/937] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:41 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:41.403076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.403565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.404000 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.404699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:41.405154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:41.405579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:41.434529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-452888b9-9e88-4b47-bec1-7fc38e7ebbf7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Aug 07 12:28:41.435107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 484/938] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:41 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:42.228056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:42.228774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:42.235053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.235542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.235980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.236681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.237133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.237555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.340872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "name": "network-vif-unplugged", "status": "completed", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:42.350989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.351502 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.351989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.365637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] Creating event network-vif-unplugged:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:28:42.371428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-20d3a9b3-aebc-4848-9bfa-ac682adb701d req-29f68b1e-d37d-4bf0-9fcb-6f3f1f1c5c8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034669 Aug 07 12:28:42.372033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 485/939] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:42.372610 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:42.381034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:42.384863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:42.384863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c36b0652-1adf-4895-9132-06a908077fd4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.159682 Aug 07 12:28:42.384863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 455/940] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:42 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:42.418210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:42.418913 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:42.425643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.426152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.426766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.427498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.427956 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.428384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.446196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:42.448508 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:42.455630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.456114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.456598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.457293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:42.457739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:42.458159 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:42.487919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f4782e87-3eb3-485c-9de0-bed2e6b5b3dc tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Aug 07 12:28:42.488474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 456/941] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:42 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:42.562377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:42.569857 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7772cfbc-536a-4cb4-891d-8aa6eef45de4 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.156043 Aug 07 12:28:42.570433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 486/942] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:42 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:43.408181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:43.408785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:43.415212 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.418940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.418940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.418940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.418940 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.419399 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.500288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:43.502478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:43.509127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.509628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.510063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.510760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.511239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.511661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.541795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aa8734fb-643b-4ac3-b237-010e6e3afd9c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Aug 07 12:28:43.542567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 487/943] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:43 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:43.556904 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:43.564675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:43.566157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:43.567335 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4aafd6dc-4322-4cb6-b674-ce00ba553f20 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.163131 Aug 07 12:28:43.567899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 457/944] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:43 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:43.591465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:43.592112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:43.598578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.600485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.600485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.600485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:43.600860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:43.601050 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:43.732047 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:43.740236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-12bb203c-70b4-4f6e-ba8a-63c42289df87 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.152570 Aug 07 12:28:43.740807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 488/945] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:43 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:44.388954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "name": "network-vif-unplugged", "status": "completed", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:44.398739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.399240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.399673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.413305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] Creating event network-vif-unplugged:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:28:44.418125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-faff65e0-da2b-4eac-9786-ae598e14236f req-8df5ad1b-4352-485a-b5c3-3409a33c242f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033154 Aug 07 12:28:44.419079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 458/946] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:44.554156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:44.556344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:44.563234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.563679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.564123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.564821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.565280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.565708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.590410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:44.591221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:44.595941 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ebb30b3a-99ed-4dc2-936c-9095a7c8d68c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Aug 07 12:28:44.596737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 489/947] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:44 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:44.600631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.600631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.600631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.600631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.601037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.601037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.761059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:44.761908 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:44.764416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:44.768320 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.768879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.769383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.770090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:44.770531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:44.770954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:44.772793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:44.774309 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:44.775514 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-63e79294-3b2b-4190-b12d-deeb197108c3 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.189606 Aug 07 12:28:44.776083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 459/948] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:44 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:44.907880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:44.915382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e6f4f2b9-23a1-443b-b091-1df6e8d855ac tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.158140 Aug 07 12:28:44.915952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 490/949] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:44 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:45.607341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:45.610224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:45.616875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.617352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.617784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.618470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.618914 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.619356 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.636466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=100 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:45.649701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e365da92-c5cd-4957-8dad-6460f4803473 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Aug 07 12:28:45.650265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 460/950] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:45 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:45.798018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:45.798854 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:45.805614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.806090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.806596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.807326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.807775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.808195 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.938729 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:45.940000 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:45.949802 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.951230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.951918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.953330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:45.953998 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:45.954902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:45.962279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:45.971173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:45.973326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:45.974727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-64043dc5-4c4c-42d5-8c7e-2f4a0e9060f8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.181034 Aug 07 12:28:45.976553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 491/951] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:45 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:46.662311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:46.664585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:46.670503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:46.671566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:46.672009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:46.672904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:46.673357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:46.673808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:46.695208 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:46.702958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7daa498d-a34a-49e1-8e7a-f4b649f02656 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044615 Aug 07 12:28:46.705765 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-63b2b641-848a-4c06-a629-8f8655d73978 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1569 microversion: 2.1 time: 0.772423 Aug 07 12:28:46.712606 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 461/952] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:45 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1569 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:46.712772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 492/953] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:28:46 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 07 12:28:46.776402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:46.776908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:46.784312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:46.784794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:46.785228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:46.785917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:46.786364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:46.786963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:46.813589 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:28:47.002006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:47.002006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:47.008241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.009001 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.009643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.010466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.011379 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.011891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.033730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:47.141875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8605d60c-e62e-4513-bc96-045d2ac8c938 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 204 len: 0 microversion: 2.1 time: 0.368902 Aug 07 12:28:47.142493 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 462/954] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:28:46 2022] DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:28:47.151891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:47.152808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:47.160813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.161333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.161772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.162584 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.163087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.169478 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.169626 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:47.172374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:47.173985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:47.175603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-948501bb-9c56-44ad-8ee5-03858e7fb665 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.179926 Aug 07 12:28:47.176242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 493/955] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:46 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:47.358076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad948861-53f3-4a0f-a3be-1fbef5e5470f", "name": "network-vif-deleted", "tag": "a2d542a2-a6f8-437f-8893-825634726b94"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:47.367809 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.368282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.368712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.373142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:47.380432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] Creating event network-vif-deleted:a2d542a2-a6f8-437f-8893-825634726b94 for instance ad948861-53f3-4a0f-a3be-1fbef5e5470f on hv-cinder-84984 Aug 07 12:28:47.381769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4df2a9d1-58e5-47f8-a864-5323bb2e0de1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1682 microversion: 2.1 time: 0.234612 Aug 07 12:28:47.382334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 463/956] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:47 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:47.394217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-26fe23db-aef9-4345-94f6-1ccab98799a0 req-290b153a-dbb2-48c5-bba4-060af0747dca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039835 Aug 07 12:28:47.394947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 494/957] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:28:47.728229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:47.728859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:47.736148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.736626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.737052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.737745 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:47.738192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:47.738609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:47.803467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:47.811083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b0245dd3-cac1-4bcb-aa97-7f900000f7f5 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1383 microversion: 2.1 time: 0.086700 Aug 07 12:28:47.811701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 464/958] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:47 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1383 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:48.011789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1969441541", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:48.064281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] validate_networks() for None {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:28:48.197976 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:48.198498 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:48.204765 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.205794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.205794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.206388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.206841 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.207289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.338744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.339378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:28:48.339815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:28:48.340296 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:28:48.340711 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:28:48.341122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:28:48.346779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.348299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.349447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-84a18ef3-bb43-4d53-a6d3-d9c6f8bdbed4 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.155604 Aug 07 12:28:48.350057 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.350217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 465/959] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:48 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:48.350859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.351332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.352062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.352518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.352944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.369774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Getting quotas for project df8016a4d76146b7a327002a04951ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:28:48.373723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Getting quotas for user 1caf5d7efce94320ba032c1ef3f5ca52 and project df8016a4d76146b7a327002a04951ee2. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:28:48.385138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:28:48.387495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:28:48.405218 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:48.405822 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:48.411686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.412162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.412592 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.413274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.413716 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.414139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.537855 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9392f08b-da48-4973-8569-66ba2038360f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530664 Aug 07 12:28:48.538870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 495/960] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:28:48.549320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.550140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6255ebfc-4ee6-427d-884c-e7926b8150bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:48.550936 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6255ebfc-4ee6-427d-884c-e7926b8150bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:48.559238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6004bebf-ac1e-483d-be21-f4a5af56b3f8 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1682 microversion: 2.1 time: 0.157133 Aug 07 12:28:48.567847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 466/961] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:48 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:48.603736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6255ebfc-4ee6-427d-884c-e7926b8150bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.611594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6255ebfc-4ee6-427d-884c-e7926b8150bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1215 microversion: 2.1 time: 0.066282 Aug 07 12:28:48.612261 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 496/962] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:48 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:48.831732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:48.832893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:48.841687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.842341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.843528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.844510 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:48.845117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:48.845685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:48.909516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:48.917114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5ad173f1-e703-48ba-b90e-beaab7c241e8 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1219 microversion: 2.1 time: 0.089875 Aug 07 12:28:48.917679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 467/963] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:48 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:49.373074 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:49.373691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:49.380584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.381075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.381512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.382202 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.382654 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.383111 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.514505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:49.523341 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:49.530172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:49.530172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-90fc39ae-92a6-4529-abae-dd13c0ce2a04 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.156980 Aug 07 12:28:49.530172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 497/964] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:49 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:49.580921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:49.581524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:49.587581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.589632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.589632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.589632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.589632 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.590004 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.633140 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:49.633829 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:49.640973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.641472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.641989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.643087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.643607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.644137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.708826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:49.716308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9426afb5-f7a0-48a6-a5fb-c9e69b9be982 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1219 microversion: 2.1 time: 0.087874 Aug 07 12:28:49.722879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 498/965] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:49 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:49.723172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:49.728831 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9929221b-724f-46ab-927e-7ed69a11a202 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1682 microversion: 2.1 time: 0.152533 Aug 07 12:28:49.729387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 468/966] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:49 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:49.939755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:49.940287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:49.946223 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.946709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.947524 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:49.948382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:49.948844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:49.949271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.009628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:50.017354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-de289bf8-59d2-42d8-8a4d-75eecde6501f tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1219 microversion: 2.1 time: 0.082164 Aug 07 12:28:50.017924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 499/967] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:49 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:50.549714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:50.550317 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:50.556748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.557229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.557663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.558344 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.558793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.559241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.723948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:50.733570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:50.735139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:50.736257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:50.736746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5f4b1dd6-0953-4a37-95fe-170febaeba15 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1724 microversion: 2.20 time: 0.191314 Aug 07 12:28:50.736883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:50.740823 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:50.743370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 469/968] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:50 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:50.745942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.746620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.747394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.748372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.749084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.750456 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.752880 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:50.753484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:50.771875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.776325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.776325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.776325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:50.776325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:50.777068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:50.823210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:50.835518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-549a0a36-9955-4e56-a5ec-94f41a0160fb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1219 microversion: 2.1 time: 0.103352 Aug 07 12:28:50.836382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 500/969] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:50 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:51.008564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.027149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-307d2a64-ce31-4f7c-94e3-ee687bf6ae18 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1682 microversion: 2.1 time: 0.282118 Aug 07 12:28:51.027826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 470/970] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:50 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:51.037384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:51.038213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:51.047763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.052630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.052630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.052630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.052630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.053314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.137332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.145866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e306bc7c-7d25-44c2-ac50-747bcf6b8dae tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1219 microversion: 2.1 time: 0.112211 Aug 07 12:28:51.146725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 501/971] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:51 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:51.761825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:51.762578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:51.776331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.776331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.776331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.776331 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.776725 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.776725 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.805558 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477dcbef-a34b-4451-b3d6-ae71a4d2e7c8", "name": "network-vif-deleted", "tag": "7bb2553d-2953-40cb-955c-2aa311377b30"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:51.817812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.818290 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.818948 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.831527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] Creating event network-vif-deleted:7bb2553d-2953-40cb-955c-2aa311377b30 for instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 on hv-cinder-84984 Aug 07 12:28:51.836947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-9df6520f-fcde-4018-b8cb-f50a29055dcf req-8c5493e7-ccb3-450d-ad01-9fb91d537301 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037284 Aug 07 12:28:51.839162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 502/972] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:51.859098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:51.859895 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:51.867458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.867959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.868397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.869332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.869842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.870287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.925248 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.933416 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.935307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.937184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c5dbb49a-8633-47bc-9cb4-734481e54292 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1667 microversion: 2.20 time: 0.178882 Aug 07 12:28:51.938332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 471/973] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:51 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1667 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:51.947780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:51.960289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5408b399-8b28-42c5-a767-8b2cb4cd5a36 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1267 microversion: 2.1 time: 0.106774 Aug 07 12:28:51.961450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 503/974] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:51 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:51.963963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1024e002-a349-4f52-b3a7-abd5f97c0c8d"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:51.967162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:51.974090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.974664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.975341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:51.976114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:51.976665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:51.978842 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.053943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:52.055325 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:52.066068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.068463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.068463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.069130 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.069758 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.070357 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.167509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:52.178643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-117cae00-5d3a-48c1-b395-2a7e968a97ff tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1615 microversion: 2.1 time: 0.129358 Aug 07 12:28:52.180420 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 504/975] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:52 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1615 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:52.185180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:52.185796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:52.193540 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.194020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.194451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.195174 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.195630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.196053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.248781 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.249275 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.249717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.250171 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lazy-loading 'fault' on Instance uuid ad948861-53f3-4a0f-a3be-1fbef5e5470f {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:28:52.305600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b0a65629074281bd0ac256bf4c5ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879759a492b427d99fea0ed4f410908', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:52.312582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-96e61a60-e880-42cf-ba23-456e4d8087d6 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 200 len: 1224 microversion: 2.1 time: 0.131006 Aug 07 12:28:52.313193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 505/976] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:52 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:52.982132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:52.982812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:52.989789 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.990466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.990774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:52.991497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:52.992089 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:52.992513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.071521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:53.076213 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:53.079651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d73d6825-170e-45ff-a3cb-739153eb8e8f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1273 microversion: 2.1 time: 0.101732 Aug 07 12:28:53.080422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 506/977] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:52 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:28:53.157709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4a78479e-460c-4c43-a135-110c9233e2ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.200181 Aug 07 12:28:53.158429 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 472/978] 10.222.0.30 () {62 vars in 1364 bytes} [Sun Aug 7 12:28:51 2022] POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments => generated 188 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 07 12:28:53.203557 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:53.204453 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:53.213275 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.213900 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.214620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.215746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.216418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.222066 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.253352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.253828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.254258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.254696 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'fault' on Instance uuid 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:28:53.305807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:53.308762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-06646e50-0958-4dca-81d2-08ff25cf5e16 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 200 len: 1331 microversion: 2.1 time: 0.110862 Aug 07 12:28:53.309498 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 507/979] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:53 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:53.312114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:53.312658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:53.319690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.320403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.320843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.321548 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.321999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.322426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.338981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:53.340359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] [instance: ad948861-53f3-4a0f-a3be-1fbef5e5470f] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:53.346802 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.347687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.348221 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.349215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:53.350118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:53.350772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] HTTP exception thrown: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Request method failure captured: Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f HTTP/1.1 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi766WpUNPgIm2B2tlIV2lJ0nDlqSUMac1TF9Zq77YF6BSh5o2BujiCxtSjPJ_w_J3bJGkLnbsc1p_PS_llr6MAFYqymeFXx9tbcGJFWUNNtIiNM4VqD2xOU_40pLdj9Cy2pmzFuSl1AfZKdRi8Bp7HVCazkZbdvhkQXfd6W_QhT1GphI Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: c879759a492b427d99fea0ed4f410908 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-TestShelveInstance-841367748 Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:28:53.381879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c879759a492b427d99fea0ed4f410908", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c879759a492b427d99fea0ed4f410908"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c879759a492b427d99fea0ed4f410908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c879759a492b427d99fea0ed4f410908"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-TestShelveInstance-841367748 Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: c879759a492b427d99fea0ed4f410908 Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-TestShelveInstance-841367748 Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-TestShelveInstance-841367748-project Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: f3b0a65629074281bd0ac256bf4c5ce8 Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-TestShelveInstance-841367748-project Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. Aug 07 12:28:53.383607 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'ad948861-53f3-4a0f-a3be-1fbef5e5470f'} Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:28:53.384549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. Aug 07 12:28:53.386185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:53.387683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Returning 404 to user: Instance ad948861-53f3-4a0f-a3be-1fbef5e5470f could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:28:53.387683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e98f02ea-4dbf-4d8a-ac77-394163e97413 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f" status: 404 len: 111 microversion: 2.1 time: 0.038299 Aug 07 12:28:53.387683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 508/980] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:53 2022] GET /compute/v2.1/servers/ad948861-53f3-4a0f-a3be-1fbef5e5470f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:28:53.636569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7109da58-1712-471c-b2e8-92f6e2211475 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] Calling method '.version_select at 0x7f7797e92790>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:53.732767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7109da58-1712-471c-b2e8-92f6e2211475 tempest-TestShelveInstance-841367748 tempest-TestShelveInstance-841367748-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1783280060" status: 202 len: 0 microversion: 2.1 time: 0.099938 Aug 07 12:28:53.733526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 509/981] 10.222.0.30 () {58 vars in 1254 bytes} [Sun Aug 7 12:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1783280060 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:28:54.095524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-75468148-4def-4f30-898d-866624f73d49 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments/1024e002-a349-4f52-b3a7-abd5f97c0c8d" status: 202 len: 0 microversion: 2.20 time: 0.787894 Aug 07 12:28:54.096480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 473/982] 10.222.0.30 () {60 vars in 1457 bytes} [Sun Aug 7 12:28:53 2022] DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments/1024e002-a349-4f52-b3a7-abd5f97c0c8d => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 12:28:54.101796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:54.105042 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:54.128525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.129353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.129977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.130871 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.133458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.136860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.190570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:54.191205 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:54.197421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.198148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.198586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.199299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.200042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.200466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.231479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118243) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 07 12:28:54.373902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:54.381997 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b323613b-577e-4a5b-a2eb-f353e6d9f91e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.284838 Aug 07 12:28:54.382741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 510/983] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:54 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:54.387454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:54.388316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:54.418251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.418828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.419382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.420159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.420742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.421172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.435043 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 HTTP/1.1 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:28:54.437346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:28:54.438818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '477dcbef-a34b-4451-b3d6-ae71a4d2e7c8'} Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:28:54.442299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:28:54.443703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:28:54.445990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:28:54.445990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bb37e0dc-0483-4e2f-9e74-3f66d8b0bda5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 404 len: 111 microversion: 2.1 time: 0.055019 Aug 07 12:28:54.445990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 511/984] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:54 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:28:54.447947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-618076c3-ea69-46fd-8985-91d55feaa4e1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '.version_select at 0x7f7797e4cc10>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:54.541716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-618076c3-ea69-46fd-8985-91d55feaa4e1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892588261" status: 202 len: 0 microversion: 2.1 time: 0.097499 Aug 07 12:28:54.542530 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 512/985] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 12:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892588261 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:28:54.593893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-610c15a4-526e-4708-88b4-9d56c4591a98 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/action" status: 202 len: 0 microversion: 2.20 time: 0.408087 Aug 07 12:28:54.594497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 474/986] 10.222.0.30 () {62 vars in 1319 bytes} [Sun Aug 7 12:28:54 2022] POST /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 07 12:28:54.602739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:54.603717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:54.610358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.614559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.614559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.614559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:54.614559 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:54.614945 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:54.836001 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:54.843314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:54.844914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:54.846130 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2ea5ff3e-8064-45e5-9b77-0c175af83764 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1675 microversion: 2.20 time: 0.247537 Aug 07 12:28:54.846901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 513/987] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:54 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1675 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:28:55.145793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0905ad2b-c74a-421c-be3e-67933b2cd6d6", "tag": "27bdfc56-b7f3-4d80-9c93-4617925b79a9"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:55.162055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:55.164102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:55.164773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:55.165688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:55.182735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] Creating event network-changed:27bdfc56-b7f3-4d80-9c93-4617925b79a9 for instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 on hv-cinder-84984 Aug 07 12:28:55.191764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-a16303c5-8826-4b59-b67f-9b5470b42742 req-3c2950fe-9d57-4fcd-ba31-c59407d8396a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051219 Aug 07 12:28:55.192771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 475/988] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:55.404289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:55.406243 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:55.415033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:55.415555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:55.416572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:55.416714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:55.417472 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:55.417904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:55.870224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:55.871243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:55.878562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:55.879760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:55.880198 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:55.880917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:55.881370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:55.881796 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:55.922924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:55.930467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a41c2e99-605f-4a78-802c-b4d17155e0e7 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.530297 Aug 07 12:28:55.931308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 514/989] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:55 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:56.096849 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:56.104011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:56.105512 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:56.106682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d5e8ae56-1f71-4941-a92a-cd97b4f5c72a tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1675 microversion: 2.20 time: 0.241651 Aug 07 12:28:56.107269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 476/990] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:55 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:56.433150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-589b3ca8-91b5-4c60-b3f6-18e78dec53cd tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: .version_select at 0x7f7797e925e0>, body: {"keypair": {"name": "tempest-keypair-1458948304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOI6GXOtgJmXV5E4IhMVjZ1gXVh1quv7mUrQbozd1ghJNAuW4Ntw3sFzmv7K6H7jIWOI3CG1JcrQQHAqDKSE6v00QaZv4bKsXw4687mEXw2g807CpgArG7IfrjvUpq5bw=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:56.452056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-589b3ca8-91b5-4c60-b3f6-18e78dec53cd tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:28:56.456172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-589b3ca8-91b5-4c60-b3f6-18e78dec53cd tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:28:56.547676 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-589b3ca8-91b5-4c60-b3f6-18e78dec53cd tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119826 Aug 07 12:28:56.548661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 515/991] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:28:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:28:56.954501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:56.955141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:56.961707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:56.962191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:56.964504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:56.964504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:56.964504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:56.964504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:57.130097 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:57.132727 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:57.140122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:57.140898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:57.141491 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:57.142644 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:57.143293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:57.143714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:57.163435 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:57.236676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:57.245854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0bd21089-655f-48d4-bb05-05cc3c9e1c24 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.295866 Aug 07 12:28:57.250092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 477/992] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:56 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:57.305025 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:57.324293 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:57.325851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:57.327507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-582d6ec0-bc9c-4511-aba8-6e673a3279ae tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.201145 Aug 07 12:28:57.328270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 516/993] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:57 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:58.269712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:58.270987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:58.277893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:58.279035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:58.279845 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:58.281965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:58.282821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:58.283695 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:58.351635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:58.352888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:58.359872 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:58.360612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:58.361245 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:58.362110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:58.362716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:58.363319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:58.363932 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:28:58.467211 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:58.475252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6ad19e64-7c3d-4687-a3d0-22b37bf0823c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.209851 Aug 07 12:28:58.476078 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 478/994] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:58 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:58.682024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:58.691020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:58.692841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:58.694497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-040cfd30-08fb-414d-8548-0f6930d07de7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.346758 Aug 07 12:28:58.704049 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 517/995] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:58 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:28:59.496394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:59.496944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:59.522553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:59.528382 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:59.529177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:59.530701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:59.531406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:59.545130 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:59.718337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:28:59.718952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:28:59.725869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:59.730778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:59.731486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:59.739715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:28:59.740459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:28:59.741110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:28:59.795762 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:59.811384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4f245686-6498-42ea-817c-fd79b964ac96 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.319125 Aug 07 12:28:59.814329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 479/996] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:28:59 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:28:59.933269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1404129576", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "722d3266-c358-4a1b-818a-9b2ef5a91e93"}], "security_groups": [{"name": "tempest-securitygroup--1007405397"}], "key_name": "tempest-keypair-1458948304", "user_data": "}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:28:59.970656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:59.981035 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:59.990082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:28:59.991642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c745a6a2-a140-4ce7-ac13-9eccc8f69214 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.277243 Aug 07 12:29:00.000536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 518/997] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:28:59 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:00.110055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] validate_networks() for [('722d3266-c358-4a1b-818a-9b2ef5a91e93', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:29:00.690805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0905ad2b-c74a-421c-be3e-67933b2cd6d6", "name": "network-vif-plugged", "status": "completed", "tag": "27bdfc56-b7f3-4d80-9c93-4617925b79a9"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:00.701129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:00.701819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:00.702415 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:00.718175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] Creating event network-vif-plugged:27bdfc56-b7f3-4d80-9c93-4617925b79a9 for instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 on hv-cinder-84984 Aug 07 12:29:00.724244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-d9f97359-7608-4399-8eee-d31e2393acc1 req-85ce34e8-b361-4f81-8efd-bbae7ac343c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Aug 07 12:29:00.727802 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 519/998] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:29:00.834515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:00.835973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:00.850028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:00.852354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:00.858551 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:00.859542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:00.860083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:00.864834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:01.048304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:01.056316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-444429c9-99d0-4648-8fc2-d93ea7ad5908 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.226942 Aug 07 12:29:01.070463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 520/999] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:00 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:01.075758 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:01.077126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:01.086345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:01.088426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:01.089058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:01.089934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:01.090544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:01.091309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:01.261504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:01.272575 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:01.274398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:01.276735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-87bf721e-c191-4a23-99a0-1998c7e2ace7 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.204735 Aug 07 12:29:01.281549 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 521/1000] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:01 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:01.317591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:29:01.318267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:29:01.319074 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:29:01.319675 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:29:01.320846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:29:01.332642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:01.333410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:01.334036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:01.335183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:01.335832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:01.336424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:01.356981 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:29:01.362069 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Getting quotas for user 10eaef565cf54b939bf78eba060f83d0 and project 555fce0b106b485db6a6800bdced08d2. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:29:01.375527 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:29:01.379417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:29:01.537118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-04b633e0-1224-48be-aba9-a751def47c54 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.605457 Aug 07 12:29:01.537771 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 480/1001] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:28:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:29:01.549476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-94626edc-50f8-4dd8-a878-443c9482b106 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:01.550494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-94626edc-50f8-4dd8-a878-443c9482b106 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:01.656893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-94626edc-50f8-4dd8-a878-443c9482b106 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:01.667196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-94626edc-50f8-4dd8-a878-443c9482b106 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1242 microversion: 2.1 time: 0.121670 Aug 07 12:29:01.668073 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 522/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:01 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:02.078180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:02.079012 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:02.089144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.089651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.090097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.090812 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.095442 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.096061 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.303114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:02.304072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:02.311902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.320220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.328024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.328024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.328024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.328024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.380320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:02.392684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8b7a30b9-f2ad-4d74-bf0d-6bb22b43b7b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.318902 Aug 07 12:29:02.406815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 481/1003] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:02 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:02.562458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:02.571370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:02.579056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:02.580288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-95759474-3fa7-411d-91e1-9016b18589cb tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.281673 Aug 07 12:29:02.580856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 523/1004] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:02 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:02.688779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:02.689395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:02.696658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.697149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.697633 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.698386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:02.698843 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:02.699312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:02.838231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:02.854987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a7383af0-8f31-456a-9d93-01fef6bcb50c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.168188 Aug 07 12:29:02.857304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 482/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:02 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:03.413969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:03.414740 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:03.422499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.423175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.423780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:03.424561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.425185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.425712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:03.611748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:03.612420 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:03.618447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:03.635971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-644118b2-03bc-4a0c-8097-4e61048e4a1f tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.225820 Aug 07 12:29:03.636494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 524/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:03 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:03.651985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.652682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.653283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:03.655467 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.656100 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.656713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:03.896951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:03.898128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:03.901733 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:03.906587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:03.908136 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:03.909329 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-73fc28c2-98a5-4763-941b-75c7a85844cf tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.310035 Aug 07 12:29:03.912241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.912731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.916487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 483/1007] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:03 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:29:03.917127 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:03.917955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:03.918423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:03.918849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:04.043112 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:04.064106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b16fd99e-aaee-4b8b-836a-654a16459d80 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.183329 Aug 07 12:29:04.085884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 525/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:03 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:04.668051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:04.669673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:04.680008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:04.680455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:04.680900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:04.683876 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:04.684351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:04.684794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:04.862309 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:04.870476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e262491a-5d0b-4f62-a38b-8518e8af7db5 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.216740 Aug 07 12:29:04.883500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 484/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:04 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:04.941955 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:04.942573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:04.955509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:04.955998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:04.956443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:04.957155 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:04.957681 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:04.958094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:05.105924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:05.106530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:05.106746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:05.116771 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:05.119630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:05.119854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:05.120352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:05.121055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:05.121185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-476d2323-5d30-4d33-a17b-9eb7f7c99062 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.183208 Aug 07 12:29:05.121625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 526/1010] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:04 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:05.127292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:05.127292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:05.127292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:05.207980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:05.216567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5ccca9c5-5ffb-405f-b0b2-f6ea4071a6f4 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.114395 Aug 07 12:29:05.230027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 485/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:05 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:05.893312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:05.893924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:05.900505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:05.900994 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:05.901428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:05.902122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:05.902572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:05.902991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:06.049705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:06.058151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d2d7d44f-4a20-4f63-b592-a6ea8425c581 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.168718 Aug 07 12:29:06.058759 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 527/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:05 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:06.149603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:06.151434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:06.167320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:06.167320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:06.167601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:06.168515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:06.169032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:06.169667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:06.245060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:06.245826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:06.252147 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:06.252708 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:06.253354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:06.262295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:06.262950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:06.264149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:06.336141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:06.351028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:06.352710 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:06.354025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-54ef4f7b-d86d-428e-94f5-702fe4e2eb58 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.211866 Aug 07 12:29:06.356720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 486/1013] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:06 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:06.377305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:06.385468 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-40f90149-e3ba-4264-81b3-4cea5644dd25 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.145314 Aug 07 12:29:06.400273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 528/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:06 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:07.079405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:07.080039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:07.086010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.086603 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.087071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.087857 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.088315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.088740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.103684 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:07.257241 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:07.268562 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a85cd5c4-4a27-4c65-b1a0-7dfb97ed1a0c tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.193632 Aug 07 12:29:07.279039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 487/1015] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:07 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:07.378704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:07.379537 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:07.387235 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.387864 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.388311 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.390420 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.391098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.391689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.410162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:07.410778 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:07.422959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.423488 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.423936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.424653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:07.425108 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:07.425525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:07.528636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:07.538752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-bb760827-9b2f-436f-ae87-be2848fdea60 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.132849 Aug 07 12:29:07.551305 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 488/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:07 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:07.559569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:07.568889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:07.583262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:07.583262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-49c0300e-9635-4653-8b5a-6e0ccf501e8b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.198804 Aug 07 12:29:07.583262 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 529/1017] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:07 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:08.291827 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:08.292386 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:08.298973 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.299507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.299948 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.300659 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.301144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.301570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.434656 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:08.442605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b4a725a1-e793-4bfd-b47b-3f97a332f15e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.155066 Aug 07 12:29:08.443680 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 489/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:08 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:08.561400 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:08.561966 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:08.568411 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.568897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.569332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.570031 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.570483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.570910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.605463 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:08.606085 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:08.612966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.613465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.613928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.614618 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:08.615099 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:08.615530 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:08.636250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:08.644552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-149bfc56-cbd8-4dbf-b0ea-f7b1ebd13e4b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1246 microversion: 2.1 time: 0.087526 Aug 07 12:29:08.645133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 530/1019] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:08 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:08.746881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:08.754957 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:08.756522 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:08.757725 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c263425f-5eaf-4584-a16b-294ea7fd84ec tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.156788 Aug 07 12:29:08.758271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 490/1020] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:08 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:29:09.463884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:09.464497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:09.470512 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.471006 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.471466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.472154 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.472609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.473034 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.606407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:09.614669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a77260c3-b445-4d0a-a329-e8cf78db6883 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.154634 Aug 07 12:29:09.615389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 531/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:09 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:09.667143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:09.668226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:09.676324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.676810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.677323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.678194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.678678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.679310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.742125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:09.749536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-64f232c7-a621-464e-9a6d-bc574e8787b2 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1238 microversion: 2.1 time: 0.088184 Aug 07 12:29:09.750101 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 491/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:09 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:09.781952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:09.782561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:09.788659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.792231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.792231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.792231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:09.792231 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:09.792700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:09.922268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:09.930548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:09.935396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:09.935396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a54b1aee-e58f-4ed4-ab48-189a673734dc tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.155743 Aug 07 12:29:09.935396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 532/1023] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:09 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:10.693698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:10.694343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:10.700774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.701816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.702645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:10.703383 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.703840 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.704273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:10.774234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:10.774960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:10.781786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.782317 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.782821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:10.783745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.784203 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.784935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:10.838547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:10.846341 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d6b1b5d3-695f-40d2-bc53-78e9e4ff72d9 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1315 microversion: 2.1 time: 0.156550 Aug 07 12:29:10.846916 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 492/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:10 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:10.863314 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:10.869773 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-057a0703-81da-4c0c-9281-9176ff5a6506 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1294 microversion: 2.1 time: 0.099468 Aug 07 12:29:10.870342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 533/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:10 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:10.959464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:10.960982 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:10.968143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.971195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.971195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:10.971195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:10.971733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:10.972190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:11.108531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:11.117441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:11.118954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:11.120192 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-564a6083-d109-4ead-95e2-4863d7ec875c tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.167644 Aug 07 12:29:11.120951 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 493/1026] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:10 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:11.868146 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:11.868762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:11.870775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=14 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:11.876795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:11.877288 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:11.877724 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:11.878421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:11.878869 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:11.879335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:11.891584 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:11.892266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:11.894060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:11.895531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:11.900829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:11.901315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:11.901826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:11.902458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:11.902918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:11.903342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:11.970676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:11.979123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ef5ae1cd-0ccb-4640-859c-1e1c994a8040 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1294 microversion: 2.1 time: 0.091660 Aug 07 12:29:11.979761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 494/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:11 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:12.020143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:12.023718 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=100 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:12.029528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-710ad084-0352-41d8-a9ad-aa874cbdfad8 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1464 microversion: 2.1 time: 0.164836 Aug 07 12:29:12.030380 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 534/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:11 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:12.076990 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:12.077481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:12.083788 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.085238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.085238 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.085483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.085808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.086227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.113708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:29:12.144437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:12.145051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:12.151169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.151813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.152301 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.152943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.153425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.153846 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.303061 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:12.313403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:12.314902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:12.316087 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-1a808a5e-728b-4a55-91ad-000a74368042 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.175582 Aug 07 12:29:12.316643 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 535/1029] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:12 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:29:12.525819 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "name": "network-vif-plugged", "status": "completed", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:12.536515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.536993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.537428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.695764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] Creating event network-vif-plugged:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:29:12.700877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-0def0828-8d92-478a-94d6-7ad155fa2358 req-a13a28c2-7f95-4afd-8229-83427e936c15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178741 Aug 07 12:29:12.701465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 536/1030] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:29:12.977153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dacb8eb3-c46c-4919-a787-c2e17bc1ba38 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 204 len: 0 microversion: 2.1 time: 0.904153 Aug 07 12:29:12.978452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 495/1031] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:29:12 2022] DELETE /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:29:12.988951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:12.989807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:12.996780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:12.997969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:12.998645 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:12.999579 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:13.000217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:13.000833 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:13.001265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:13.003126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:13.008922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:13.009406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:13.010455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:13.011351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:13.011803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:13.012227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:13.086743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:13.095398 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-af46991a-435f-4ab5-b2d0-502e59ddb007 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1302 microversion: 2.1 time: 0.099110 Aug 07 12:29:13.095975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 496/1032] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:12 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:13.145021 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:13.152717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-489d724a-556b-4693-9cea-abbe5c02e5b1 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1470 microversion: 2.1 time: 0.168940 Aug 07 12:29:13.153280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 537/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:12 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:13.339655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:13.340179 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:13.346732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:13.354773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:13.354773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:13.354773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:13.354773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:13.355221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:13.480149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:13.488302 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:13.489799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:13.490956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b4229934-78d8-48ff-bbb7-8694461c5964 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.155357 Aug 07 12:29:13.491607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 497/1034] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:13 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:14.116634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:14.117253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:14.124706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.125184 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.125613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.126302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.126749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.127207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.174593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:14.175475 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:14.181875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.182424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.182922 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.183767 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.184687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.184687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.189924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:14.197539 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f27bcee3-22c8-45a6-871d-7c4c96133adb tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1312 microversion: 2.1 time: 0.084794 Aug 07 12:29:14.198227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 538/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:14 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:14.514076 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:14.514808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:14.521030 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.521522 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.521967 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.522668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:14.523152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:14.523583 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:14.655577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:14.663529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:14.665260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:14.666532 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aa3624ce-7595-472a-ab7e-2fa509d7f4a9 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.156952 Aug 07 12:29:14.667396 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 539/1036] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:14 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:29:14.699721 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:14.708030 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-541fb85e-a7f4-462e-8800-dc3cd1b9b897 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1470 microversion: 2.1 time: 0.537508 Aug 07 12:29:14.708711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 498/1037] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:14 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1470 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:15.217954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:15.219213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:15.225906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:15.229705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.233697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.233697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.233697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.233697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.234287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.299333 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:15.306924 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7f2a0a5e-991d-4532-aa4e-9642d42a7274 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1300 microversion: 2.1 time: 0.093122 Aug 07 12:29:15.307527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 540/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:15 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:15.504273 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0905ad2b-c74a-421c-be3e-67933b2cd6d6", "name": "network-vif-deleted", "tag": "27bdfc56-b7f3-4d80-9c93-4617925b79a9"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:15.526883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.527517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.528045 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.546141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] Creating event network-vif-deleted:27bdfc56-b7f3-4d80-9c93-4617925b79a9 for instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 on hv-cinder-84984 Aug 07 12:29:15.551526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-3d399337-b66c-4bb1-afcb-0841c8b25dc1 req-bd547ffd-1460-4c12-bddf-76be6cd6f19c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053153 Aug 07 12:29:15.552441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 499/1039] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:29:15.690168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:15.690894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:15.697957 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.698584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.699284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.700098 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.701207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.701721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.732125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:15.732734 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:15.741756 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.747148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.747148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.747148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:15.747148 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:15.748206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:15.876995 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:15.889546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:15.891238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:15.892430 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-812a13ee-a6be-4e6f-8a31-979e1f2d1822 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.207363 Aug 07 12:29:15.892993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 541/1040] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:15 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:15.912093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:15.922364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1c6d5a60-8081-4335-9aa8-c4683531709e tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1300 microversion: 2.1 time: 0.195702 Aug 07 12:29:15.931057 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 500/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:15 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:16.329874 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:16.330495 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:16.337046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.338467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.338467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.338757 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.339196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.339628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.483690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:16.491424 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f1e2bbcb-a0d4-4316-b1eb-ddf0fba7223c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.166945 Aug 07 12:29:16.493350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 542/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:16 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:16.915737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:16.916890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:16.924103 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.924803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.925428 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.926517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.927216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.927817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.943673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:16.944576 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:16.952120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.953019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.953717 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.954596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.955239 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.955896 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.990520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:16.991027 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:16.991656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:16.992114 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lazy-loading 'fault' on Instance uuid 0905ad2b-c74a-421c-be3e-67933b2cd6d6 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:29:17.037749 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1caf5d7efce94320ba032c1ef3f5ca52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df8016a4d76146b7a327002a04951ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:17.045196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fbb9fd27-4734-4159-ad76-f9c741be31b2 tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 200 len: 1305 microversion: 2.1 time: 0.105293 Aug 07 12:29:17.046306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 543/1043] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:16 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:17.152384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:17.161214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:17.162808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:17.164096 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-552e4994-db51-441b-993f-94ae8c735abe tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1733 microversion: 2.20 time: 0.253034 Aug 07 12:29:17.164952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 501/1044] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:16 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1733 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:17.512647 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:17.513296 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:17.520792 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:17.521291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:17.521721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:17.522425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:17.522892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:17.523345 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:17.566970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee80bb8-3f4f-499a-9514-c21261c67a76", "tag": "d906d625-00ee-43b7-8493-b74935dd1406"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:17.576039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:17.576519 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:17.577703 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:17.588433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] Creating event network-changed:d906d625-00ee-43b7-8493-b74935dd1406 for instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 on hv-cinder-84984 Aug 07 12:29:17.593366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-297c5f56-ab31-4503-9575-88f298214a7f req-2454fca3-a89d-4b13-bbfd-601980011e96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030274 Aug 07 12:29:17.593957 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 502/1045] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:29:17.653453 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:17.661315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bb6e53db-04f1-45c5-9009-c9f84ac59255 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.152517 Aug 07 12:29:17.661877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 544/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:17 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:18.067177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:18.067885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] [instance: 0905ad2b-c74a-421c-be3e-67933b2cd6d6] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:18.074385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.074875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.075352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.076051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.076516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.076977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.090220 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] HTTP exception thrown: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Request method failure captured: Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 HTTP/1.1 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi76_9iLIP8x8PK6JEoa7VMz0vQZEBDiOjXBnpwepz8usCv9b65AZ4NODXO5eKY6gzbHVtsHIlWvrD9sf5NUPnB6ng80Iwctdy2bjl6rq4Dne4Os1hYKwykyRFXgC3_sU6eOKmPnlQglNoQAqObEFauv83kADkguwDOZB2auoFaDxFmcc Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: df8016a4d76146b7a327002a04951ee2 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-VolumesNegativeTest-1727333127 Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:29:18.091909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_df8016a4d76146b7a327002a04951ee2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df8016a4d76146b7a327002a04951ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/df8016a4d76146b7a327002a04951ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/df8016a4d76146b7a327002a04951ee2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-VolumesNegativeTest-1727333127 Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: df8016a4d76146b7a327002a04951ee2 Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-VolumesNegativeTest-1727333127 Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-VolumesNegativeTest-1727333127-project Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 1caf5d7efce94320ba032c1ef3f5ca52 Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-VolumesNegativeTest-1727333127-project Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. Aug 07 12:29:18.094269 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '0905ad2b-c74a-421c-be3e-67933b2cd6d6'} Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:18.095345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. Aug 07 12:29:18.096935 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:18.098322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] Returning 404 to user: Instance 0905ad2b-c74a-421c-be3e-67933b2cd6d6 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:18.098322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8247d411-4805-4da5-b806-612deab224bb tempest-VolumesNegativeTest-1727333127 tempest-VolumesNegativeTest-1727333127-project] 10.222.0.30 "GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6" status: 404 len: 111 microversion: 2.1 time: 0.030958 Aug 07 12:29:18.098322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 503/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:18 2022] GET /compute/v2.1/servers/0905ad2b-c74a-421c-be3e-67933b2cd6d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:29:18.187040 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:18.187916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:18.194083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.194640 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.195185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.195972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.196490 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.197120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.338975 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:18.348193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:18.349704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:18.350894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9a399e81-3ad5-46bc-997d-8c2da14b2530 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1720 microversion: 2.20 time: 0.169148 Aug 07 12:29:18.351571 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 545/1048] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:18 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:18.682723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:18.683379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:18.689996 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.690476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.690911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.691664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:18.692117 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:18.692538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:18.707713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:18.826946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:18.834385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c414032b-8128-4f07-9f19-314ded7ea1b7 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.155841 Aug 07 12:29:18.834942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 504/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:18 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:19.855907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:19.856446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:19.863522 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:19.864008 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:19.864447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:19.865134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:19.865593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:19.866020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:20.003046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:20.010429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d8d9dbc0-7c47-4c6b-841a-39da76153312 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.158443 Aug 07 12:29:20.010990 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 546/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:19 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:21.037232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:21.037927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:21.045067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:21.045655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:21.046257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:21.047077 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:21.047536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:21.047956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:21.183828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:21.191846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6d252649-f504-4349-a35d-dbfc7e714828 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.159455 Aug 07 12:29:21.192351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 505/1051] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:21 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:22.214670 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:22.215362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:22.222172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:22.222523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:22.222961 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:22.223691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:22.224176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:22.224606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:22.361619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:22.372011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7156f9c5-b9cf-401d-97d6-f1742fddf65d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.162726 Aug 07 12:29:22.372614 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 547/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:22 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:22.650477 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee80bb8-3f4f-499a-9514-c21261c67a76", "name": "network-vif-plugged", "status": "completed", "tag": "d906d625-00ee-43b7-8493-b74935dd1406"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:22.662449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:22.663021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:22.663551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:22.677027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] Creating event network-vif-plugged:d906d625-00ee-43b7-8493-b74935dd1406 for instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 on hv-cinder-84984 Aug 07 12:29:22.683133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-650a0dea-288c-4dd1-9b8a-d36760c33ca3 req-5dffbee7-d4b7-4e1c-bb3f-c174bf8d1dd6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038069 Aug 07 12:29:22.683821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 506/1053] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:29:23.394448 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:23.395093 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:23.401457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:23.401943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:23.402382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:23.403110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:23.403565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:23.405159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:23.767151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:23.774576 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4e71e496-2c93-472d-9b24-335858cc487b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1368 microversion: 2.1 time: 0.383974 Aug 07 12:29:23.775165 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 548/1054] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:23 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:29:24.797083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:24.797776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:24.805786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:24.805786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:24.805786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:24.806145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:24.806274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:24.806705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:24.951384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:24.959553 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-428b5172-142f-4d1c-bf01-5d963057e2ab tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1559 microversion: 2.1 time: 0.168062 Aug 07 12:29:24.960409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 507/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:29:24 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:24.981413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:24.982041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:24.989702 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:24.990183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:24.990620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:24.991350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:24.991832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:24.992257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:25.072876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-293c607b-fee6-42b6-88fc-aaab048ac387 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095792 Aug 07 12:29:25.073459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 549/1056] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:29:24 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:29:26.058020 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee80bb8-3f4f-499a-9514-c21261c67a76", "tag": "d906d625-00ee-43b7-8493-b74935dd1406"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:26.064091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:26.069270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:26.069742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:26.070163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:26.081552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] Creating event network-changed:d906d625-00ee-43b7-8493-b74935dd1406 for instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 on hv-cinder-84984 Aug 07 12:29:26.086485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-f5af6d03-3cbe-4d37-b013-0d611f01984d req-f9edc1b3-5ce5-48b1-8076-6921b1c542a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Aug 07 12:29:26.087235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 508/1057] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:29:49.746734 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=21 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:49.747690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=86 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:49.751816 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:49.755807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:49.760019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:49.760496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:49.760929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:49.761712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:49.762161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:49.762581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:49.793139 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d8d6c252-14bc-4bcf-a18d-7a19b736fb10 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047888 Aug 07 12:29:49.793674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 550/1058] 10.222.0.30 () {60 vars in 1343 bytes} [Sun Aug 7 12:29:49 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:29:49.855837 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:49.856366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:49.858983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=19 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:29:49.864146 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:49.866650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:49.866650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:49.866650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:49.866650 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:49.867032 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:49.891736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:29:50.161191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e81c9165-136c-4d55-90bd-192671138bba tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 204 len: 0 microversion: 2.20 time: 0.309211 Aug 07 12:29:50.161828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 509/1059] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 12:29:49 2022] DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 12:29:50.170625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:50.171347 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:50.177883 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:50.184423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:50.184423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:50.184423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:50.184423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:50.184827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:50.313723 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:50.321641 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:50.323201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:50.324370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2dbb1d14-f7c0-4c0a-858d-8310e29693c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.158279 Aug 07 12:29:50.324925 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 551/1060] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:50 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:51.347821 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:51.348528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:51.355020 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:51.355518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:51.355954 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:51.356638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:51.357237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:51.357662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:51.491418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:51.499405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:51.500909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:51.502072 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c1e3911b-49e8-486e-aa61-bd934578df74 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1726 microversion: 2.20 time: 0.158543 Aug 07 12:29:51.502701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 510/1061] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:51 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 07 12:29:52.525944 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:52.526679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:52.535437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:52.535934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:52.536520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:52.537343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:52.537801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:52.538256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:52.604326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:52.614521 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:52.616055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8fb20cfc3b6479198059b4383f47527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547ebf661b1b48f289d734a71b494889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:29:52.617248 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f46ce35f-dc67-4ab4-a8d9-d85dc48044ca tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 200 len: 1658 microversion: 2.20 time: 0.095222 Aug 07 12:29:52.617805 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 552/1062] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:52 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 1658 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 07 12:29:52.750859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b2a50-c582-4736-b142-a14efe56020a", "name": "network-vif-deleted", "tag": "0e62222a-3989-4b1b-95a8-39cb74c31d39"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:29:52.767801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:52.768288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:52.768708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:52.785623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] Creating event network-vif-deleted:0e62222a-3989-4b1b-95a8-39cb74c31d39 for instance 801b2a50-c582-4736-b142-a14efe56020a on hv-cinder-84984 Aug 07 12:29:52.796810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-2433b8c7-ab1e-4e58-897c-90c1c897c382 req-556261d0-c14d-47e4-a2e4-77b13128864c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050042 Aug 07 12:29:52.802370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 511/1063] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:29:53.646690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:53.647433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:53.654024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:53.654587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:53.655206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:53.655915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:53.656374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:53.656804 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:53.671591 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a HTTP/1.1 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:29:53.673713 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:53.675292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '801b2a50-c582-4736-b142-a14efe56020a'} Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:53.676123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:53.677899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:53.680014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:53.680014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-17a5c33d-5c75-4f8f-9a0b-6a6b78164565 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 404 len: 111 microversion: 2.20 time: 0.032267 Aug 07 12:29:53.680014 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 553/1064] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:53 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 07 12:29:53.685866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0828e89c-d609-4a85-a5f5-286f4df3334b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '.version_select at 0x7f77a429f160>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:53.762346 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0828e89c-d609-4a85-a5f5-286f4df3334b tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426158722" status: 204 len: 0 microversion: 2.20 time: 0.081131 Aug 07 12:29:53.763193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 512/1065] 10.222.0.30 () {60 vars in 1262 bytes} [Sun Aug 7 12:29:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426158722 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 07 12:29:55.863824 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:55.864404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:55.870796 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:55.871316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:55.871755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:55.872451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:55.872907 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:55.873326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:55.886463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a HTTP/1.1 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:29:55.888867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.890933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '801b2a50-c582-4736-b142-a14efe56020a'} Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:55.891880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.893398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.895199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:55.895199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d29b67cb-3e16-4d42-8424-c8785aa15924 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 404 len: 111 microversion: 2.20 time: 0.030325 Aug 07 12:29:55.895199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 554/1066] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 12:29:55 2022] DELETE /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:29:55.899871 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:55.900655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 801b2a50-c582-4736-b142-a14efe56020a] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:55.908779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:55.909257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:55.909681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:55.910367 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:55.910859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:55.911304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:55.924728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a HTTP/1.1 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:29:55.926316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.928036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '801b2a50-c582-4736-b142-a14efe56020a'} Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:55.929134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. Aug 07 12:29:55.930629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:55.931983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 801b2a50-c582-4736-b142-a14efe56020a could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:55.931983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c818557f-6965-4444-9dab-159ee56810c8 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a" status: 404 len: 111 microversion: 2.20 time: 0.032142 Aug 07 12:29:55.931983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 513/1067] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:55 2022] GET /compute/v2.1/servers/801b2a50-c582-4736-b142-a14efe56020a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:29:57.195946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:57.196422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:57.202788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:57.203298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:57.203737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:57.204426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:57.204877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:57.205302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:57.219741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 HTTP/1.1 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:29:57.221300 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.223052 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '4c38525f-a106-4669-87ad-fd3e321a65d7'} Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:57.224199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.225712 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.227671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:57.227671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a0c00163-8fe4-4568-b6c6-4a41306ad04e tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 404 len: 111 microversion: 2.20 time: 0.030722 Aug 07 12:29:57.227671 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 555/1068] 10.222.0.30 () {60 vars in 1280 bytes} [Sun Aug 7 12:29:57 2022] DELETE /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:29:57.231408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:29:57.232628 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] [instance: 4c38525f-a106-4669-87ad-fd3e321a65d7] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:29:57.238985 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:57.239500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:57.239941 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:57.240630 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:29:57.241078 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:29:57.241500 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:29:57.254345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] HTTP exception thrown: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Request method failure captured: Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 HTTP/1.1 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi765mfTowgIQUeqLRE813vwpBNmXb7cM-uOMPn4k0tVuIuJua5R2LXSgcTM0D8d2DfDmx_9dzvrLco3et_EoziySVcaZ6IpEsMxGSOJ3ASZFwOZuUrzrIqNt7PmT1JWOcAHeVLFnWL8QKuGBLAtZ2aRYPSG1XJyp_4eyzAvut2oRVtCU Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Openstack-Nova-Api-Version: 2.20 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:29:57.255897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_547ebf661b1b48f289d734a71b494889", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/547ebf661b1b48f289d734a71b494889"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/547ebf661b1b48f289d734a71b494889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 547ebf661b1b48f289d734a71b494889 Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1987953052 Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: c8fb20cfc3b6479198059b4383f47527 Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1987953052-project Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.257744 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '4c38525f-a106-4669-87ad-fd3e321a65d7'} Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:29:57.258690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. Aug 07 12:29:57.260028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:29:57.261297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] Returning 404 to user: Instance 4c38525f-a106-4669-87ad-fd3e321a65d7 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:29:57.261297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5f240881-be8c-4c9e-b4a6-17d4e82f99e1 tempest-AttachVolumeShelveTestJSON-1987953052 tempest-AttachVolumeShelveTestJSON-1987953052-project] 10.222.0.30 "GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7" status: 404 len: 111 microversion: 2.20 time: 0.030011 Aug 07 12:29:57.261297 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 514/1069] 10.222.0.30 () {60 vars in 1277 bytes} [Sun Aug 7 12:29:57 2022] GET /compute/v2.1/servers/4c38525f-a106-4669-87ad-fd3e321a65d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 07 12:30:04.286839 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:04.288208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:04.295654 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:04.296136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:04.296569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:04.297272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:04.297866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:04.298298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:04.330934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-29f9b4df-b1e7-4e5d-bc2e-16d3f5538bcf tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/ips" status: 200 len: 150 microversion: 2.1 time: 0.047822 Aug 07 12:30:04.331440 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 556/1070] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:30:04 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:06.078724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb64b890-07b9-4819-b077-4dc3b9457091"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:06.081124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:06.088163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:06.088682 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:06.089008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:06.089707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:06.090323 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:06.091464 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:07.023189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-62c1c7c4-04df-436c-9fd8-228ab910a244 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "POST /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948322 Aug 07 12:30:07.023859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 515/1071] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:30:06 2022] POST /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:08.895431 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-711c9eca-8f38-486e-a81f-3dbc5f68294d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: .version_select at 0x7f77a4c20d30>, body: {"keypair": {"name": "tempest-keypair-198889902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJd00ItFK0mNUaCIiBV3DMxkTlcDFEb/A3ZnXvIS1b8is1t5evdUdisfy2ZbxR/11SqOcG6TwIU35afm4Y3HTrEZq7p9+tN7qHRTj0lwuJ7zcp/JlZA8gTxw0AdCj01tBw=="}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:08.910662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-711c9eca-8f38-486e-a81f-3dbc5f68294d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:30:08.914470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-711c9eca-8f38-486e-a81f-3dbc5f68294d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for user 20f7cd1ed1214372a5c6f441fb98f799 and project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'key_pairs'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:30:09.000493 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-711c9eca-8f38-486e-a81f-3dbc5f68294d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.245619 Aug 07 12:30:09.001096 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 557/1072] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:30:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:11.293921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2115971435", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37925fed-4419-4188-9e1e-d33d0d447d9b"}], "security_groups": [{"name": "tempest-securitygroup--816164823"}], "key_name": "tempest-keypair-198889902", "user_data": "}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:11.442598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] validate_networks() for [('37925fed-4419-4188-9e1e-d33d0d447d9b', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:30:11.894612 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:30:11.895350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:30:11.895894 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:30:11.896371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:30:11.896844 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:30:11.907374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:11.908098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:11.908698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:11.909418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:11.910024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:11.910621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:11.929125 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:30:11.939168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for user 20f7cd1ed1214372a5c6f441fb98f799 and project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:30:11.953713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:30:11.956111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:30:12.112090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4084ad04-b5ee-4c3d-87b1-7694a1987e10 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.823550 Aug 07 12:30:12.112797 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 516/1073] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:30:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:30:12.130601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ff20dd89-2324-4245-9ec8-34e95f109a62 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:12.132134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ff20dd89-2324-4245-9ec8-34e95f109a62 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:12.222038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ff20dd89-2324-4245-9ec8-34e95f109a62 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:12.232976 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ff20dd89-2324-4245-9ec8-34e95f109a62 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1237 microversion: 2.1 time: 0.112264 Aug 07 12:30:12.233968 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 558/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:12 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:13.253761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:13.254369 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:13.261638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:13.262119 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:13.262546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:13.263265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:13.264564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:13.265040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:13.327479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:13.335394 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1ef02fce-0ac4-4ce8-ab60-2a91dcc7f488 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1241 microversion: 2.1 time: 0.085827 Aug 07 12:30:13.336010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 517/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:13 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:14.356987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:14.358084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:14.360764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=28 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:14.365635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:14.366116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:14.366553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:14.367263 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:14.367715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:14.368137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:14.431268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:14.439689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d4982db9-8644-4a41-80f7-d8175411261a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1233 microversion: 2.1 time: 0.086946 Aug 07 12:30:14.440253 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 559/1076] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:14 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:15.461956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:15.463447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:15.471286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:15.471783 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:15.472256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:15.472970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:15.473425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:15.473861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:15.707740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:15.716206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-da71f26e-fe2a-4d1d-bd71-73381c34afea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1307 microversion: 2.1 time: 0.258744 Aug 07 12:30:15.723711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 518/1077] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:15 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:15.787843 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:15.788340 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:15.794637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:15.795683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:15.796120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:15.796798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:15.797247 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:15.797668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:15.879133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'services' on Instance uuid 6ee80bb8-3f4f-499a-9514-c21261c67a76 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:30:16.108791 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bed201a8-4ed3-4fd3-b83f-ba851db84b90 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments/eb64b890-07b9-4819-b077-4dc3b9457091" status: 202 len: 0 microversion: 2.1 time: 0.320299 Aug 07 12:30:16.109507 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 560/1078] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:30:15 2022] DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments/eb64b890-07b9-4819-b077-4dc3b9457091 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:30:16.118476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:16.123810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:16.130418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:16.131041 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:16.132312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:16.132312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:16.132879 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:16.133377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:16.165010 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-420ec982-df94-41cf-9e19-24189ad67f10 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051045 Aug 07 12:30:16.165613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 519/1079] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:30:16 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:30:16.743741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:16.744454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:16.752080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:16.752705 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:16.753246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:16.754131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:16.754688 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:16.755250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:16.895706 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:16.903267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d7005317-eecb-4a3c-b394-c9162875f87a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.167874 Aug 07 12:30:16.903828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 561/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:16 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:17.179839 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:17.182826 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:17.190202 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:17.190697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:17.191686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:17.191891 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:17.192751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:17.193170 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:17.224581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-2d257813-ab6f-448e-b441-85de59b34f2a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050104 Aug 07 12:30:17.225174 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 520/1081] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:30:17 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:17.396500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a97721-b0a6-4775-9b66-7b065fd093db", "tag": "e1422ed2-50cc-4404-9b43-eec4eb9d878e"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:17.408494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:17.408977 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:17.409628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:17.422305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] Creating event network-changed:e1422ed2-50cc-4404-9b43-eec4eb9d878e for instance 32a97721-b0a6-4775-9b66-7b065fd093db on hv-cinder-84984 Aug 07 12:30:17.427306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-647cfae5-c1c4-4d32-9858-4260b4f155dc req-72e88c7d-1d6b-419e-9784-25855ac9e6bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Aug 07 12:30:17.428536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 562/1082] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:30:17.924748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:17.925557 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:17.931664 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:17.932153 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:17.932590 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:17.933284 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:17.933735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:17.934160 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.149619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:18.158019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c1c19ce0-f29e-438a-8895-1337ee62acdb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.237932 Aug 07 12:30:18.158898 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 521/1083] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:17 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:18.238826 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:18.241190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:18.247652 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.248270 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.248987 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.249837 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.250372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.251080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.281386 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b5152eab-f41f-4297-8bf8-0b43f9a6acae tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047484 Aug 07 12:30:18.281951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 563/1084] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:30:18 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:30:18.342915 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:18.343459 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:18.349799 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.350288 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.350723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.351444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.351961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.352418 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.378340 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:30:18.666184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-efda62b7-a2f8-4234-b61a-8d1bffd2514d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 204 len: 0 microversion: 2.1 time: 0.327441 Aug 07 12:30:18.666693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 522/1085] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:30:18 2022] DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:30:18.675299 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:18.675981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:18.681942 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.682426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.682868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.683600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:18.684059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:18.684489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:18.817525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:18.825284 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-81ed0234-2888-48cf-bdc8-feecdd83ef8b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1683 microversion: 2.1 time: 0.153917 Aug 07 12:30:18.825861 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 564/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:18 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:19.179813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:19.180556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:19.187059 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:19.187536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:19.187968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:19.188645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:19.189089 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:19.189536 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:19.331145 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:19.335330 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7380da8a-d4f7-40ef-8915-d28bec9595b5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.159742 Aug 07 12:30:19.335890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 523/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:19 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:19.848009 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:19.848632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:19.851145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:19.855863 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:19.856353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:19.862922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:19.862922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:19.862922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:19.862922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:19.994063 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:20.002062 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-267a22fb-85da-4f4a-81e2-95e62f954f2f tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1683 microversion: 2.1 time: 0.157962 Aug 07 12:30:20.002625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 565/1088] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:19 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:20.356784 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:20.357924 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:20.360366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:20.365193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:20.365681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:20.366126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:20.366817 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:20.367303 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:20.367732 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:20.370379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:20.497644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:20.504842 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8c0436aa-9cc9-4ab0-8627-ab188059315d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.152276 Aug 07 12:30:20.505408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 524/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:20 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:21.023959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:21.024688 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:21.031410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:21.031892 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:21.032326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:21.033016 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:21.033467 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:21.033891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:21.165383 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:21.174191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4a46bac0-ac6a-4d33-93ce-8a4db61d9c8c tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1683 microversion: 2.1 time: 0.154299 Aug 07 12:30:21.174762 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 566/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:21 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:21.526180 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:21.526795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:21.534162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:21.534654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:21.535122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:21.535824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:21.536285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:21.536709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:21.764279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:21.772060 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1e3c8e3b-4bff-4c46-9e12-00a41aa70b75 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.250158 Aug 07 12:30:21.772772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 525/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:21 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:22.180500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee80bb8-3f4f-499a-9514-c21261c67a76", "name": "network-vif-deleted", "tag": "d906d625-00ee-43b7-8493-b74935dd1406"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:22.194601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:22.195179 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:22.195677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:22.196002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:22.196937 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:22.203375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:22.204342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:22.206123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:22.206672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:22.207195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:22.207952 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:22.208596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:22.209291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:22.210083 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] Creating event network-vif-deleted:d906d625-00ee-43b7-8493-b74935dd1406 for instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 on hv-cinder-84984 Aug 07 12:30:22.215505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-a9ec19cd-47b8-4a34-8355-ec1c0eb56a92 req-e8005793-ab89-488e-96f3-831882fe0066 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038682 Aug 07 12:30:22.216181 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 567/1092] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:22.289325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:22.297963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c68b930e-ebf6-4148-8259-088befaf87db tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1615 microversion: 2.1 time: 0.106092 Aug 07 12:30:22.298642 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 526/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:22 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:22.791126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=6 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:30:22.796458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:22.797638 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:22.805011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:22.811319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:22.811319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:22.811319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:22.811319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:22.811808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:22.959250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:22.969029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ce5b3361-fafb-4ef3-a9eb-0c9084fb422a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.178830 Aug 07 12:30:22.969958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 568/1094] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:22 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:23.004588 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a97721-b0a6-4775-9b66-7b065fd093db", "name": "network-vif-plugged", "status": "completed", "tag": "e1422ed2-50cc-4404-9b43-eec4eb9d878e"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:23.015315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:23.015793 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:23.016224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:23.027353 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] Creating event network-vif-plugged:e1422ed2-50cc-4404-9b43-eec4eb9d878e for instance 32a97721-b0a6-4775-9b66-7b065fd093db on hv-cinder-84984 Aug 07 12:30:23.032655 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-91f8be8d-c69c-40db-b6e4-499ca64b0a7c req-da3a2314-8058-491a-a34e-220da6eaee38 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 Aug 07 12:30:23.033231 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 527/1095] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:23.320836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:23.321444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:23.328045 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:23.328460 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:23.328890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:23.329604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:23.330054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:23.330474 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:23.363110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:23.363597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:23.364026 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:23.364485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lazy-loading 'fault' on Instance uuid 6ee80bb8-3f4f-499a-9514-c21261c67a76 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:30:23.415793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10eaef565cf54b939bf78eba060f83d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '555fce0b106b485db6a6800bdced08d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:23.427433 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c862dcad-7865-478c-9d16-4b205f7b8397 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 200 len: 1332 microversion: 2.1 time: 0.110356 Aug 07 12:30:23.428024 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 569/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:23 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:23.991311 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:23.992035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:23.998810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:23.999316 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:23.999748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:24.000432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:24.000880 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:24.001299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:24.150798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:24.158501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ecf15f30-9e8b-44a8-ba0d-4945cd6d2327 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.171496 Aug 07 12:30:24.159077 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 528/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:23 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:24.449678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:24.450322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:24.457237 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:24.457726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:24.458161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:24.458860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:24.459361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:24.459782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:24.472786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 HTTP/1.1 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:30:24.474408 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:24.476142 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '6ee80bb8-3f4f-499a-9514-c21261c67a76'} Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:24.477175 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:24.478838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:24.480359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:24.480359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ecd8f46b-58ca-471a-bcde-8deec82d295a tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 404 len: 111 microversion: 2.1 time: 0.030023 Aug 07 12:30:24.480359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 570/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:24 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:30:24.485291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d0ff2bd8-9375-425c-90c4-793d32766b8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '.version_select at 0x7f77975d0af0>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:24.599575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d0ff2bd8-9375-425c-90c4-793d32766b8d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458948304" status: 202 len: 0 microversion: 2.1 time: 0.118455 Aug 07 12:30:24.600154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 529/1099] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 12:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458948304 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:30:25.179599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:25.180273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:25.186295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:25.186862 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:25.187321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:25.188028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:25.188491 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:25.188922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:25.400330 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:25.410051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a8a478a4-bd74-46a9-8420-cc4926596991 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1362 microversion: 2.1 time: 0.234504 Aug 07 12:30:25.411081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 571/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:25 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:26.433298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:26.433908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:26.440139 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.440626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.441068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.441761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.442217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.442645 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.570838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:30:26.578819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4b8b7588-8467-45cb-9b22-1aa34085ddaf tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1549 microversion: 2.1 time: 0.150024 Aug 07 12:30:26.579415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 530/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:26 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:30:26.600680 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:26.601267 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:26.607370 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.607912 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.608286 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.608999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.609425 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.609847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.677092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:26.681207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:26.684182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.684639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.685158 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.686333 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.686803 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.687257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.690851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-78ba4cd0-7ce6-4aea-b587-6b1b3ce6729c tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095303 Aug 07 12:30:26.691485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 572/1102] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:30:26 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:26.704093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 HTTP/1.1 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:30:26.705779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.710503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '6ee80bb8-3f4f-499a-9514-c21261c67a76'} Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:26.711533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.713247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.714814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:26.714814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ed049327-5e57-42bc-9387-7e041110b95d tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 404 len: 111 microversion: 2.1 time: 0.034044 Aug 07 12:30:26.714814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 531/1103] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:30:26 2022] DELETE /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:30:26.718191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:26.718801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 6ee80bb8-3f4f-499a-9514-c21261c67a76] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:26.724774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.725255 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.725690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.726446 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:26.726815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:26.727291 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:26.740581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 HTTP/1.1 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:30:26.742118 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.743935 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '6ee80bb8-3f4f-499a-9514-c21261c67a76'} Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:26.744958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. Aug 07 12:30:26.746510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:26.748496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 6ee80bb8-3f4f-499a-9514-c21261c67a76 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:26.748496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9c14e4bd-3097-4634-8d8a-4de20b089755 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76" status: 404 len: 111 microversion: 2.1 time: 0.030084 Aug 07 12:30:26.749372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 573/1104] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:26 2022] GET /compute/v2.1/servers/6ee80bb8-3f4f-499a-9514-c21261c67a76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:30:27.940919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32a97721-b0a6-4775-9b66-7b065fd093db", "tag": "e1422ed2-50cc-4404-9b43-eec4eb9d878e"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:30:27.953175 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:27.953740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:27.954243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:27.969872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] Creating event network-changed:e1422ed2-50cc-4404-9b43-eec4eb9d878e for instance 32a97721-b0a6-4775-9b66-7b065fd093db on hv-cinder-84984 Aug 07 12:30:27.975270 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-f5740c86-760a-4038-add4-ed967106da57 req-f1f3d0f5-c429-47d1-91f0-1ab4fea117f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041502 Aug 07 12:30:27.976018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 532/1105] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:30:28.048110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:28.052510 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:28.055478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.056143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.056765 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.058123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.058578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.059278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.074627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 HTTP/1.1 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:30:28.076931 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.078698 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '477dcbef-a34b-4451-b3d6-ae71a4d2e7c8'} Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:28.083937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.085528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.087266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:28.087266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e591a8e9-3db7-4d28-8547-942af282dd99 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 404 len: 111 microversion: 2.1 time: 0.038799 Aug 07 12:30:28.087266 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 574/1106] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:30:28 2022] DELETE /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:30:28.090324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:28.091042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:28.100893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.102708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.103810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.104694 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.105310 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.105893 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.132335 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 HTTP/1.1 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:30:28.134462 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.139490 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '477dcbef-a34b-4451-b3d6-ae71a4d2e7c8'} Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:28.140424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. Aug 07 12:30:28.141928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.143307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:28.143307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e344836c-b305-4cf3-bc0f-a5f86a4aade1 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8" status: 404 len: 111 microversion: 2.1 time: 0.050212 Aug 07 12:30:28.143307 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 533/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:28 2022] GET /compute/v2.1/servers/477dcbef-a34b-4451-b3d6-ae71a4d2e7c8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:30:28.153538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:28.154351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:28.162060 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.162797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.163587 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.164477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.165250 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.165834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.181456 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 HTTP/1.1 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:30:28.183363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.185122 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '7d749f04-654d-4f11-8827-2849cd637994'} Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:28.186088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.188828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.190123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:28.190123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-66aa60d2-1590-4cb7-a958-f0cfcd6d2ad9 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 404 len: 111 microversion: 2.1 time: 0.041416 Aug 07 12:30:28.190123 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 575/1108] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:30:28 2022] DELETE /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:30:28.197134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:28.197737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 7d749f04-654d-4f11-8827-2849cd637994] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:28.207292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.208039 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.208658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.209364 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:28.209813 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:28.210292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:28.229523 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 HTTP/1.1 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:30:28.231090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.233244 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '7d749f04-654d-4f11-8827-2849cd637994'} Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:28.234743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. Aug 07 12:30:28.236276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:28.237689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 7d749f04-654d-4f11-8827-2849cd637994 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:28.237689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6f02b91c-73dd-413b-a981-b91e55f9e6d5 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994" status: 404 len: 111 microversion: 2.1 time: 0.039703 Aug 07 12:30:28.237689 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 534/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:28 2022] GET /compute/v2.1/servers/7d749f04-654d-4f11-8827-2849cd637994 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:30:29.554015 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:29.554536 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:29.561674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:29.565844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:29.565844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:29.565844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:29.565844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:29.566258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:29.580413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 HTTP/1.1 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:30:29.581986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.583720 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '9a26c053-8ae7-4956-9ffa-ae344cea68e3'} Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:29.592897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.594458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.596055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:29.596055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b7a12887-479a-4b80-8663-9ef304513357 tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 404 len: 111 microversion: 2.1 time: 0.033417 Aug 07 12:30:29.596055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 576/1110] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:30:29 2022] DELETE /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:30:29.596336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:30:29.596336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] [instance: 9a26c053-8ae7-4956-9ffa-ae344cea68e3] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:30:29.600345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:29.600846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:29.601278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:29.601971 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:30:29.602417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:30:29.602833 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:30:29.617537 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] HTTP exception thrown: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Request method failure captured: Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 HTTP/1.1 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi7661RQZ03VsxHOGumotOVvJTM18wYA3bJ2YHxXrYEtYLEjUbhk5spdiqT3o_2Qg3IyXckDPYtRQxaZjzeBXXJMs_e7QAF9_267JiqwkXup9XGyCnYfFRffopkNdQeTHWx0cmH4weUk6HiYhSv3P805w223hOaOONKPKFoJrDJCFWZKM Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:30:29.623903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_555fce0b106b485db6a6800bdced08d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/555fce0b106b485db6a6800bdced08d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 555fce0b106b485db6a6800bdced08d2 Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1414848516 Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 10eaef565cf54b939bf78eba060f83d0 Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeNegativeTest-1414848516-project Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.625770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '9a26c053-8ae7-4956-9ffa-ae344cea68e3'} Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:30:29.627227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. Aug 07 12:30:29.628719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:30:29.630194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] Returning 404 to user: Instance 9a26c053-8ae7-4956-9ffa-ae344cea68e3 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:30:29.630194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1ba7ee7d-be3c-4cc7-b418-edf6b695448b tempest-AttachVolumeNegativeTest-1414848516 tempest-AttachVolumeNegativeTest-1414848516-project] 10.222.0.30 "GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3" status: 404 len: 111 microversion: 2.1 time: 0.032409 Aug 07 12:30:29.630194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 535/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:30:29 2022] GET /compute/v2.1/servers/9a26c053-8ae7-4956-9ffa-ae344cea68e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:31:04.218851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:04.219471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:04.221544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=25 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:04.222179 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:04.226830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:04.227358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:04.227851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:04.228554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:04.228998 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:04.229423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:04.254198 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9d683b1d-b463-4bdb-9160-89552fe5366b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/ips" status: 200 len: 147 microversion: 2.1 time: 0.039474 Aug 07 12:31:04.254853 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 577/1112] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:31:04 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:31:06.688708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6951d9a9-da52-48c5-9f86-cb0d5e35459a"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:31:06.691091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:06.694053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:06.694053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=41 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:06.698736 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:06.699354 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:06.700627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:06.701344 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:06.701798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:06.702221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:07.518308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-28762893-747d-44d9-b4e0-e3a25975a9a2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834309 Aug 07 12:31:07.518919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 536/1113] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:31:06 2022] POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:31:15.056746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:31:15.063899 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:15.064384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:15.064827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:15.124447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Going to try to stop instance {{(pid=118242) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 12:31:15.299658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-512c37af-e681-48fb-a7cd-75345ccc3b71 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action" status: 202 len: 0 microversion: 2.1 time: 0.246893 Aug 07 12:31:15.300407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 578/1114] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:31:15 2022] POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:31:15.310363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:15.310890 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:15.318546 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:15.321443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:15.321443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:15.321443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:15.321443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:15.321819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:15.454894 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:15.462969 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ceced3c9-6021-461b-a439-519d5feee428 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.157642 Aug 07 12:31:15.463639 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 537/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:15 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:16.484834 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:16.485596 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:16.491729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:16.492208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:16.492637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:16.493322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:16.493767 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:16.494186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:16.624552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:16.632637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-50c1cb49-63e4-44aa-ac65-ec97a137172d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.152589 Aug 07 12:31:16.633246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 579/1116] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:16 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:17.653022 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:17.653663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:17.660534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:17.661014 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:17.661445 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:17.662128 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:17.662575 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:17.662993 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:17.796254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:17.804135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9ddba896-5172-4241-8257-bc575c620290 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.154973 Aug 07 12:31:17.804691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 538/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:17 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:18.826084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:18.827229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:18.833644 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:18.834129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:18.834567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:18.835292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:18.835750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:18.836177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:18.969850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:18.976620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b1ae0253-9734-471a-8643-ee515cd8c5d6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.154418 Aug 07 12:31:18.977192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 580/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:18 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:19.998049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:19.999411 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:20.005830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:20.006315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:20.006752 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:20.007506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:20.007960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:20.008384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:20.144168 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:20.152195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a5375fcb-e49d-49a3-84e7-ce25a87ed9ab tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.158201 Aug 07 12:31:20.159593 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 539/1119] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:19 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:21.173523 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:21.174361 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:21.180927 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:21.181522 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:21.181962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:21.182661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:21.183151 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:21.183582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:21.314752 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:21.322784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bb3613e3-454c-4ab4-a56a-67e47affd1dd tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.153173 Aug 07 12:31:21.323388 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 581/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:21 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:22.345075 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:22.345685 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:22.352020 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:22.352497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:22.352929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:22.353609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:22.354056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:22.354478 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:22.484366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:22.492388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4340f63d-ee0e-42fb-8762-bea671ba32ea tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.151408 Aug 07 12:31:22.492946 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 540/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:22 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:23.514355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:23.515784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:23.522086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:23.527128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:23.527128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:23.527128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:23.527128 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:23.527494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:23.661259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:23.671394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dfd7a33d-eb68-47ef-9bf9-e5630a313806 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.160925 Aug 07 12:31:23.672041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 582/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:23 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:24.693235 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:24.693794 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:24.700182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:24.700671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:24.701112 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:24.701804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:24.702286 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:24.702715 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:24.831222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:24.839163 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cf705b4a-4f9c-4a65-a069-abe7d05ce1d3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.149925 Aug 07 12:31:24.839728 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 541/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:24 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:25.860037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:25.861082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:25.867258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:25.867746 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:25.868188 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:25.868888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:25.869346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:25.869774 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:25.997916 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:26.006544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-797f143b-07b5-4991-bd7b-3f26b279d4f2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.150488 Aug 07 12:31:26.007133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 583/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:25 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:27.027122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:27.027735 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:27.034673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:27.037944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:27.037944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:27.037944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:27.037944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:27.038336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:27.167707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:27.175707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d7252eb7-e3f3-4695-b6cb-ae5097107bee tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.152508 Aug 07 12:31:27.176278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 542/1125] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:27 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:28.196820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:28.197426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:28.204597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:28.205070 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:28.205504 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:28.206182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:28.206633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:28.207103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:28.346483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:28.354405 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-839e5b45-f779-4368-b850-136eccf4bb0e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.161555 Aug 07 12:31:28.354973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 584/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:28 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:29.376033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:29.376636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:29.383081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:29.383567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:29.383987 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:29.384667 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:29.385111 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:29.385531 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:29.514298 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:29.523342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e987196c-fce4-4384-8736-b0d90ef8fdd5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.151454 Aug 07 12:31:29.523929 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 543/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:29 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:30.544518 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:30.545132 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:30.552183 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:30.552656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:30.553085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:30.553766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:30.554213 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:30.554630 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:30.684385 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:30.692358 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-33c6b957-93fc-4710-8249-15b4f69c91f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.151675 Aug 07 12:31:30.692920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 585/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:30 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:31.712825 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:31.713444 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:31.720740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:31.721230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:31.721676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:31.722396 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:31.722858 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:31.723312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:31.858410 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:31.866419 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cd45f79a-b267-4a62-a017-e0cf65c65f4e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.157435 Aug 07 12:31:31.866921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 544/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:31 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:32.887690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:32.888331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:32.895399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:32.895881 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:32.896318 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:32.897007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:32.897464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:32.897891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:33.023337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:33.031965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2adc78b0-0292-4e4f-b179-5c77ed27c922 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.147410 Aug 07 12:31:33.032593 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 586/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:32 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:34.053669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:34.054268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:34.060758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:34.061239 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:34.061688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:34.062578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:34.063176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:34.063601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:34.194487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:34.202502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b8746236-c24c-4756-a6f5-9325f4e34dd2 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.152915 Aug 07 12:31:34.203155 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 545/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:34 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:35.223970 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:35.224704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:35.231161 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:35.231645 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:35.232086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:35.232777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:35.233228 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:35.233655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:35.367996 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:35.376624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3534186d-0d3b-4cdb-8e59-0800da97b6a3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.156640 Aug 07 12:31:35.377187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 587/1132] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:35 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:36.402357 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:36.402950 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:36.409818 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:36.410304 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:36.410746 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:36.411469 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:36.411921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:36.412342 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:36.545662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:36.554747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f01219f8-6bf9-4910-954f-daf13e70dc38 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1724 microversion: 2.1 time: 0.156237 Aug 07 12:31:36.555377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 546/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:36 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:37.576516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:37.577280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:37.584319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:37.584802 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:37.585244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:37.585950 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:37.586406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:37.586832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:37.716719 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:37.724891 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f636a44b-8fe0-4256-9c5c-618332c71b26 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1701 microversion: 2.1 time: 0.152268 Aug 07 12:31:37.725458 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 588/1134] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:37 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:37.746284 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:31:37.748768 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=23 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:37.754156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:37.754641 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:37.755115 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:37.783779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:37.827849 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Going to try to start instance {{(pid=118243) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 12:31:38.024393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f19a361e-d749-44ce-9fd1-e9b2d50dc7c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action" status: 202 len: 0 microversion: 2.1 time: 0.281848 Aug 07 12:31:38.025028 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 547/1135] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:31:37 2022] POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:31:38.033732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:38.034492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:38.040496 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:38.041019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:38.041457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:38.051201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:38.051201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:38.051201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:38.175562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:38.183395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7cb4275b-8ff5-41ed-9c75-fc860876f206 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1710 microversion: 2.1 time: 0.153827 Aug 07 12:31:38.183960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 589/1136] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:38 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:39.206372 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:39.207403 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:39.213283 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:39.213770 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:39.214206 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:39.214900 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:39.215381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:39.215805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:39.345486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:39.353385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-dc6438ed-c7b2-4b85-b89f-7eeb319dd353 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1710 microversion: 2.1 time: 0.152146 Aug 07 12:31:39.353947 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 548/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:39 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:40.376090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:40.376999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:40.383497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:40.383974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:40.384402 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:40.385086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:40.385535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:40.385960 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:40.515974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:40.524394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d914f141-981e-41e3-85e5-40e5fce97ba0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1710 microversion: 2.1 time: 0.152883 Aug 07 12:31:40.524983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 590/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:40 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:41.545638 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:41.546785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:41.553417 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:41.553903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:41.554339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:41.555042 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:41.555499 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:41.559051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:41.688604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:41.696693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-cd87b156-83c2-4071-8542-854fb0f3c175 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1710 microversion: 2.1 time: 0.154912 Aug 07 12:31:41.697267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 549/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:41 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:42.717623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:31:42.718246 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:31:42.724772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:42.725258 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:42.725700 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:42.726402 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:31:42.726860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:31:42.727313 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:31:42.860306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:31:42.868296 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0cf3e654-77c2-4ed2-bfec-7b1533c2c931 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1714 microversion: 2.1 time: 0.154619 Aug 07 12:31:42.868870 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 591/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:31:42 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:31:58.694122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=5 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:58.694889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:31:58.712831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:31:58.712831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:31:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:31:58.888262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-4d057156-41ad-45f1-8af4-6b0c81f71c84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Action: 'create', calling method: .version_select at 0x7f779775ef70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-629497100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/Va6P9iIVkeROhw8TMeWB0F+JJs+isVpJeUMiVpho5A0PPYXtTzzgP0qJ5PY9+M0p9E/ATIHSN1q6F8gZl8H9pl7sAE2EYHrv/m0yLtjLPzS1KdHkpw8U7rs1vYc4Lzg=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:31:58.904755 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-4d057156-41ad-45f1-8af4-6b0c81f71c84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:31:58.909300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-4d057156-41ad-45f1-8af4-6b0c81f71c84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for user 6c52cd52d25a42e29c8f049c94c903aa and project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:31:58.985804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-4d057156-41ad-45f1-8af4-6b0c81f71c84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.293100 Aug 07 12:31:58.986414 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 550/1141] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:31:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:32:16.667225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:16.667775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:16.669760 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=30 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:16.670421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:16.675848 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:16.676327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:16.676755 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:16.677439 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:16.677888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:16.678310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:16.857438 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lazy-loading 'services' on Instance uuid 32a97721-b0a6-4775-9b66-7b065fd093db {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:32:17.066683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-00ba3528-328f-4522-a3a5-f3be020c84b7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments/6951d9a9-da52-48c5-9f86-cb0d5e35459a" status: 202 len: 0 microversion: 2.1 time: 0.403588 Aug 07 12:32:17.067328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 592/1142] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:32:16 2022] DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments/6951d9a9-da52-48c5-9f86-cb0d5e35459a => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:32:18.440581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=4 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:18.441312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:18.445193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-148440918", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629497100", "security_groups": [{"name": "tempest-secgroup-smoke-362040585"}], "block_device_mapping_v2": [{"uuid": "5f2d473d-86f6-449a-b153-af550190dc01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88acb47e-551d-472f-8dc2-37ab9f7e112d"}]}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:18.619883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] validate_networks() for [('88acb47e-551d-472f-8dc2-37ab9f7e112d', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:32:18.988974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:32:18.989397 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:32:18.989865 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:32:18.990271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:32:18.990680 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:32:18.999613 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:19.000093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:19.000525 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:19.001251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:19.001712 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:19.002127 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:19.020327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:32:19.024406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for user 6c52cd52d25a42e29c8f049c94c903aa and project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:32:19.081251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:32:19.083381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f2d473d-86f6-449a-b153-af550190dc01',volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:32:19.239934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:19.246778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:19.249233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:19.249233 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:19.270055 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Going to try to stop instance {{(pid=118242) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 07 12:32:19.440674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5ab203a4-e43d-468c-a7dd-51a1de2f4cc9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action" status: 202 len: 0 microversion: 2.1 time: 0.205374 Aug 07 12:32:19.442954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 593/1143] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:32:19 2022] POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:32:19.450210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:19.450922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:19.457404 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:19.458108 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:19.458675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:19.459399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:19.459849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:19.460306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:19.595138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:19.603406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-6e780807-74be-4efa-89f3-f50b5080eb87 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.157621 Aug 07 12:32:19.604169 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 594/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:19 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:19.604325 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3b1fe93c-8bf5-4b78-9468-9c414a7a9254 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.165704 Aug 07 12:32:19.605271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 551/1145] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:32:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:32:19.618426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f10bb797-6b76-401a-a117-255aca415637 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:19.619071 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f10bb797-6b76-401a-a117-255aca415637 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:19.674754 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-f10bb797-6b76-401a-a117-255aca415637 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:19.681487 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f10bb797-6b76-401a-a117-255aca415637 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1093 microversion: 2.1 time: 0.066961 Aug 07 12:32:19.682152 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 595/1146] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:19 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:20.630625 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:20.631266 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:20.637276 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:20.637751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:20.638184 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:20.638868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:20.639586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:20.640002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:20.701726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-16ca910c-0eaf-4505-8a96-29fea3148b64 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:20.702337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-16ca910c-0eaf-4505-8a96-29fea3148b64 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:20.760173 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-16ca910c-0eaf-4505-8a96-29fea3148b64 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:20.767086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-16ca910c-0eaf-4505-8a96-29fea3148b64 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1093 microversion: 2.1 time: 0.069230 Aug 07 12:32:20.767651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 596/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:20 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:20.777651 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:20.785327 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0452402e-7021-4c00-af83-3fddfa5c79ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.159101 Aug 07 12:32:20.785875 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 552/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:20 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:21.788094 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:21.788725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:21.796323 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:21.796920 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:21.797381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:21.798193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:21.798808 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:21.799437 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:21.806095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:21.806808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:21.813374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:21.813933 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:21.814437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:21.815708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:21.816343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:21.816769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:21.863554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:21.871170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-bbba2edf-235f-4f08-bb21-c20602337d53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1191 microversion: 2.1 time: 0.087091 Aug 07 12:32:21.871985 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 597/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:21 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:21.947708 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:21.955481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-84de69d2-a867-487d-a80e-bd6bdc847790 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.153289 Aug 07 12:32:21.959646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 553/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:21 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:22.893287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:22.894397 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:22.901078 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:22.901578 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:22.902018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:22.902784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:22.903272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:22.903702 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:22.976936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:22.977704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:22.988731 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:22.989230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:22.989700 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:22.992164 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:22.992164 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:22.992164 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:23.062251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:23.071651 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-27015a7a-d1bb-451f-ab32-9c0d8318752d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1276 microversion: 2.1 time: 0.182740 Aug 07 12:32:23.075352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 598/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:22 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:23.204423 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:23.212751 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a1dafb98-07f6-43e3-9d9d-caa7eb8f715e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.240314 Aug 07 12:32:23.213506 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 554/1152] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:22 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:24.093380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:24.094084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:24.101934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:24.102653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:24.103215 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:24.108156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:24.108156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:24.108156 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:24.160953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38513b4f-faf9-4847-9f73-54991206231e", "tag": "d3a418c4-5cb2-46d4-9313-a0f56373cd17"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:24.170974 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:24.171476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:24.171905 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:24.183868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] Creating event network-changed:d3a418c4-5cb2-46d4-9313-a0f56373cd17 for instance 38513b4f-faf9-4847-9f73-54991206231e on hv-cinder-84984 Aug 07 12:32:24.191478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-24cb114a-5799-4603-ae5e-d05980ecabfc req-fb78c509-ee4b-42a1-b9df-45dac65ef4fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103760 Aug 07 12:32:24.191478 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 599/1153] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:32:24.234086 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:24.234911 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:24.242335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:24.242820 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:24.243276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:24.243970 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:24.244418 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:24.244877 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:24.279552 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:24.287828 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b693fa3c-e7b3-4d90-b641-055e9a39df91 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.198838 Aug 07 12:32:24.288503 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 555/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:24 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:24.379343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:24.387048 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fc5454e5-d4f2-41d4-92dd-3ff175aa67e0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.157113 Aug 07 12:32:24.387627 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 600/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:24 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:25.308455 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:25.309092 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:25.316271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:25.316763 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:25.317203 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:25.317906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:25.318391 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:25.318846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:25.408477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:25.409099 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:25.415716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:25.416200 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:25.416637 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:25.417332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:25.417785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:25.418208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:25.535395 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:25.542936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-07baae49-b0dc-4b83-b362-8c3d9c1ab683 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.238183 Aug 07 12:32:25.543554 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 556/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:25 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:25.552716 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:25.560279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4e10640f-1946-44ad-919e-bab19fa03003 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.155713 Aug 07 12:32:25.560842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 601/1157] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:25 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:26.563918 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:26.564533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:26.570966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:26.571473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:26.571905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:26.572584 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:26.573037 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:26.573453 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:26.584693 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:26.585308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:26.592061 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:26.592202 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:26.592515 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:26.593198 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:26.593656 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:26.594079 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:26.707586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:26.715086 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e154f254-60a1-4832-82ee-8957815e2579 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.155171 Aug 07 12:32:26.716051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 557/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:26 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:26.723878 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:26.731757 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-276a0d65-2248-41e2-83f5-f091518386a4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.151596 Aug 07 12:32:26.732354 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 602/1159] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:26 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:27.735077 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:27.735702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:27.742791 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:27.743337 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:27.743773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:27.744450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:27.744897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:27.745312 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:27.752752 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:27.753529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:27.760196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:27.760684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:27.761125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:27.761827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:27.762279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:27.762703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:27.886068 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:27.894282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-166cb9e8-0d6f-4ad2-b4cf-362b12aaee1f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.162540 Aug 07 12:32:27.894867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 558/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:27 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:27.900531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:27.908217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-03bdb7eb-1bfc-4d0d-8ab8-2983b3d649c4 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.159323 Aug 07 12:32:27.908780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 603/1161] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:27 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:28.916140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:28.916741 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:28.923438 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:28.923927 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:28.924424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:28.925570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:28.926025 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:28.926504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:28.930177 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:28.930782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:28.936788 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:28.937269 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:28.937701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:28.938384 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:28.938831 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:28.939280 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:29.011568 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:29.030769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:29.060609 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:29.069393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:29.069657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1e8da4d9-05c4-4067-a933-9cd18f218f27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.157305 Aug 07 12:32:29.070239 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 559/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:28 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:29.076951 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-54b15ebb-2d50-40af-8e91-726547deb65f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1678 microversion: 2.1 time: 0.150487 Aug 07 12:32:29.077778 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 604/1163] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:28 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:30.090339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:30.090897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:30.098293 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.098573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:30.099094 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.099228 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.099334 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:30.099889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.100336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.100757 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.105351 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.105838 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.106273 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.107251 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.107722 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.108202 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.241783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:30.245912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:30.251197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-eed77dd5-81f4-4d7b-a073-963185d2ce0b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.164737 Aug 07 12:32:30.251387 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aa1fdf32-4b9e-4053-a8d7-c74250aab49f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1655 microversion: 2.1 time: 0.157041 Aug 07 12:32:30.251795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 560/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:30 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:30.251952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 605/1165] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:30 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:32:30.272346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:30.278335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.278817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.279321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.302061 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Going to try to start instance {{(pid=118242) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 07 12:32:30.483937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3544e4ab-23d0-41ba-915b-a619f8bd93c8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action" status: 202 len: 0 microversion: 2.1 time: 0.215194 Aug 07 12:32:30.484544 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 606/1166] 10.222.0.30 () {60 vars in 1278 bytes} [Sun Aug 7 12:32:30 2022] POST /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 07 12:32:30.493441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:30.494084 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:30.500055 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.504349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.504349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.504349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:30.504349 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:30.504731 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:30.631066 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:30.638624 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f25f3869-d991-4a93-adcd-62a2f73e3bed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1664 microversion: 2.1 time: 0.149131 Aug 07 12:32:30.639482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 561/1167] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:30 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:31.270378 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=4 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:31.275033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:31.275761 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:31.281807 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:31.284278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:31.284278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:31.284278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:31.284278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:31.284639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:31.420368 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:31.428529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d91b3f64-ce73-4113-b211-ef72618fd1ad tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.158955 Aug 07 12:32:31.442934 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 607/1168] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:31 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:31.659582 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:31.660204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:31.666586 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:31.667116 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:31.667560 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:31.668300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:31.668758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:31.669187 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:31.801980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:31.809468 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-92a8a225-d6f9-49ed-830b-7634a76a4d94 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1664 microversion: 2.1 time: 0.154071 Aug 07 12:32:31.810031 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 562/1169] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:31 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:32.450196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:32.450813 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:32.457779 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:32.458272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:32.458714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:32.459436 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:32.459890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:32.460319 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:32.478585 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:32:32.593106 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:32.601571 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-13e95c89-c671-4c03-94a2-0c0fc5599534 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.155276 Aug 07 12:32:32.602149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 608/1170] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:32 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:32.831527 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:32.832162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:32.838571 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:32.839714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:32.839714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:32.840181 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:32.840631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:32.841051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:32.971814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:32.979194 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-395aabd3-cef7-4e9b-b581-2c3881d9ad81 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1668 microversion: 2.1 time: 0.152216 Aug 07 12:32:32.979764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 563/1171] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:32 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:33.621953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:33.622567 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:33.629479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:33.629962 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:33.630395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:33.631121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:33.631573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:33.631993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:33.769715 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38513b4f-faf9-4847-9f73-54991206231e", "name": "network-vif-plugged", "status": "completed", "tag": "d3a418c4-5cb2-46d4-9313-a0f56373cd17"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:33.772336 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:33.780379 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:33.780612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-753e7d5a-99bf-4207-924d-14d80bd5775c tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.162284 Aug 07 12:32:33.780906 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:33.781336 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:33.792801 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] Creating event network-vif-plugged:d3a418c4-5cb2-46d4-9313-a0f56373cd17 for instance 38513b4f-faf9-4847-9f73-54991206231e on hv-cinder-84984 Aug 07 12:32:33.794172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 609/1172] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:33 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:33.797704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-7f799290-7905-4f5d-bccf-c4beb75bddde req-4bdd4299-2c60-4b75-8de8-b882b63c4d26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Aug 07 12:32:33.798322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 564/1173] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:32:34.802219 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:34.802828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:34.809182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:34.809655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:34.810084 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:34.810763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:34.811241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:34.811664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:34.943565 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:34.950929 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b72cb4a9-f1e1-494b-8395-b2886f51558a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1264 microversion: 2.1 time: 0.153243 Aug 07 12:32:34.951533 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 610/1174] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:34 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:35.973351 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:35.974053 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:35.980207 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:35.980691 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:35.981144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:35.981815 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:35.982265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:35.982688 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:36.121141 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:36.128830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-9df68dd3-2d02-4209-aa88-8712e94125d5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1450 microversion: 2.1 time: 0.160957 Aug 07 12:32:36.129393 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 565/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:35 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:36.149252 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:32:36.149884 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:32:36.156271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:36.156753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:36.157192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:36.157879 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:36.158331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:36.159054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:36.292742 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:32:36.300736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5158e7b0-d7a6-4126-97d0-8394a5877bd5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1450 microversion: 2.1 time: 0.155402 Aug 07 12:32:36.301303 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 611/1176] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:32:36 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:32:38.336648 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38513b4f-faf9-4847-9f73-54991206231e", "tag": "d3a418c4-5cb2-46d4-9313-a0f56373cd17"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:32:38.346249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:32:38.346908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:32:38.347374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:32:38.358533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] Creating event network-changed:d3a418c4-5cb2-46d4-9313-a0f56373cd17 for instance 38513b4f-faf9-4847-9f73-54991206231e on hv-cinder-84984 Aug 07 12:32:38.365267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-4ea2501e-cd86-42fa-8c8b-e0a84f869397 req-51a081cc-06b3-4171-8821-61881740c580 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084754 Aug 07 12:32:38.365267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 566/1177] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:06.120212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:06.122442 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:06.124752 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=44 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:06.125399 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=20 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:06.129930 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.130407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.131529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.132257 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.132704 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.133124 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.161601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-352fc6fa-eddf-49fe-9fe7-080bbf25e32e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046187 Aug 07 12:33:06.162180 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 612/1178] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:33:06 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:33:06.221018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:06.221861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=84 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:06.225974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:06.226558 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:06.232617 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.233097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.233533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.234221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.234673 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.235120 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.261144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:33:06.545580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b26a02e7-bd3b-4171-b5dd-e40c693fb9de tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 204 len: 0 microversion: 2.1 time: 0.325904 Aug 07 12:33:06.546421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 567/1179] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:33:06 2022] DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:33:06.555619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:06.556271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:06.562623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.563131 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.563566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.564252 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:06.564699 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:06.565170 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:06.695541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:06.702868 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fd088ab9-281c-4ba4-a582-41349063755a tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1674 microversion: 2.1 time: 0.152044 Aug 07 12:33:06.703466 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 613/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:06 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:07.725200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:07.725895 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:07.732161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:07.732634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:07.733065 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:07.733740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:07.734182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:07.734598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:07.864481 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:07.871991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-22ab5a0f-8fa6-44f6-8679-984862577749 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1674 microversion: 2.1 time: 0.151592 Aug 07 12:33:07.872572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 568/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:07 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:33:08.893735 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:08.894381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:08.900725 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:08.901292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:08.901748 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:08.902423 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:08.902873 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:08.903331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:09.034162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:09.042701 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-aee9a08e-8853-4e6e-a00a-9f4a56d684ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1674 microversion: 2.1 time: 0.153051 Aug 07 12:33:09.045849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 614/1182] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:08 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:09.852967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32a97721-b0a6-4775-9b66-7b065fd093db", "name": "network-vif-deleted", "tag": "e1422ed2-50cc-4404-9b43-eec4eb9d878e"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:09.862631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:09.863057 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:09.863485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:09.874965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] Creating event network-vif-deleted:e1422ed2-50cc-4404-9b43-eec4eb9d878e for instance 32a97721-b0a6-4775-9b66-7b065fd093db on hv-cinder-84984 Aug 07 12:33:09.880085 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-04152c62-7710-465d-97d0-3c2eb6144f47 req-c5d5769e-2bdb-47e0-a550-fb18feca7f60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030751 Aug 07 12:33:09.881511 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 569/1183] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:10.065644 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:10.066542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:10.079897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:10.079897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:10.079897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:10.079897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:10.080236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:10.080236 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:10.151327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:10.159332 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e1664c87-d0db-4480-b826-41f23a77dac1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 200 len: 1322 microversion: 2.1 time: 0.098945 Aug 07 12:33:10.160077 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 615/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:10 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:11.181182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:11.181908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:11.188000 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:11.188483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:11.188917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:11.189605 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:11.190056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:11.190479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:11.203759 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db HTTP/1.1 Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:33:11.205434 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:33:11.207044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '32a97721-b0a6-4775-9b66-7b065fd093db'} Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:33:11.207979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:33:11.210465 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:33:11.212080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:33:11.212080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a08ef8ed-814c-455e-a318-6f6683751640 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 404 len: 111 microversion: 2.1 time: 0.030423 Aug 07 12:33:11.212080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 570/1185] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:11 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:33:11.216190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3a73c3c0-f6d2-4269-bb8d-407065bb8079 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '.version_select at 0x7f7797f05280>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:11.220625 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a73c3c0-f6d2-4269-bb8d-407065bb8079 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [116c1e3a-5b81-4fd1-bb18-e98b1833dcde] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 12:33:12.228306 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a73c3c0-f6d2-4269-bb8d-407065bb8079 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [116c1e3a-5b81-4fd1-bb18-e98b1833dcde] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53614. Aug 07 12:33:12.344185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3a73c3c0-f6d2-4269-bb8d-407065bb8079 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198889902" status: 202 len: 0 microversion: 2.1 time: 1.131712 Aug 07 12:33:12.344772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 616/1186] 10.222.0.30 () {58 vars in 1218 bytes} [Sun Aug 7 12:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198889902 => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:33:13.087401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3bf69981-a418-4599-ab9c-8c83212774d0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: .version_select at 0x7f77a67cdf70>, body: {"keypair": {"name": "tempest-keypair-2063536073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0WMdR1FngjqLI1cuwCJhNN7G6J6v2uJDxJo6Hda5SBmnSJOdnpDtIhcJnlqpWu+E1W58liAsIOAYFk3CmSvYGqmd1ttuAi9+q5d/E49pFdokepod4STNoA8tv9lRbrjw=="}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:13.103773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3bf69981-a418-4599-ab9c-8c83212774d0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:33:13.107719 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-3bf69981-a418-4599-ab9c-8c83212774d0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for user 20f7cd1ed1214372a5c6f441fb98f799 and project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'key_pairs'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:33:13.189714 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3bf69981-a418-4599-ab9c-8c83212774d0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106484 Aug 07 12:33:13.190292 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 571/1187] 10.222.0.30 () {60 vars in 1159 bytes} [Sun Aug 7 12:33:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:15.324215 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1314918013", "imageRef": "71d9f51c-9321-415c-800d-f2817b55e6e1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37925fed-4419-4188-9e1e-d33d0d447d9b"}], "security_groups": [{"name": "tempest-securitygroup--169332894"}], "key_name": "tempest-keypair-2063536073", "user_data": "}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:15.426669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.network.neutron [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] validate_networks() for [('37925fed-4419-4188-9e1e-d33d0d447d9b', None, None, None, None, None)] {{(pid=118242) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:33:15.831849 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Flavor limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:33:15.832315 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Image limits 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:33:15.832793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Flavor pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:33:15.833198 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Image pref 0:0:0 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:33:15.834238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.virt.hardware [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:33:15.843018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:15.843511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:15.843947 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:15.844668 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:15.845121 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:15.845541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:15.862278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:33:15.866326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.quota [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Getting quotas for user 20f7cd1ed1214372a5c6f441fb98f799 and project a311cd62403a4fa285c48a145dd9ccfb. Resources: {'instances', 'cores', 'ram'} {{(pid=118242) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:33:15.877194 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Going to run 1 instances... {{(pid=118242) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:33:15.879483 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71d9f51c-9321-415c-800d-f2817b55e6e1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118242) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:33:16.010659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-336eee83-2f0d-4eda-872d-72c9ce9613b0 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.691180 Aug 07 12:33:16.011264 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 617/1188] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:33:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:33:16.027044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-209364a4-81db-4451-be38-ea9776c6c6c7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:16.027671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-209364a4-81db-4451-be38-ea9776c6c6c7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:16.333047 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-209364a4-81db-4451-be38-ea9776c6c6c7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:16.340658 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-209364a4-81db-4451-be38-ea9776c6c6c7 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1238 microversion: 2.1 time: 0.322204 Aug 07 12:33:16.341224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 572/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:16 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1238 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:17.361562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:17.362176 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:17.368326 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:17.368812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:17.369252 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:17.369943 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:17.370392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:17.370812 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:17.432737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:17.440116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0b0d6f71-db4d-42c1-b04c-9ce69492b8f5 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1234 microversion: 2.1 time: 0.083007 Aug 07 12:33:17.440677 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 618/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:17 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:18.461011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:18.461631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:18.468320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:18.468814 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:18.476321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:18.476321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:18.476321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:18.476321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:18.540271 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:18.548339 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-296ee966-1595-4288-bc2e-648447cc2151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1296 microversion: 2.1 time: 0.091311 Aug 07 12:33:18.548923 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 573/1191] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:18 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:33:19.570683 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:19.571958 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:19.578327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:19.578806 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:19.579497 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:19.580276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:19.580732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:19.581160 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:19.717144 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:19.724798 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-058c5d31-63b5-4a3b-99f3-a262ad3d581e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.158523 Aug 07 12:33:19.725375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 619/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:19 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:19.767572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7fc791-2a98-497e-8c0b-870e3989d6aa", "tag": "b3e36915-c599-4170-bc99-c22f39d002ec"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:19.778204 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:19.778758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:19.789034 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:19.793842 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] Creating event network-changed:b3e36915-c599-4170-bc99-c22f39d002ec for instance fb7fc791-2a98-497e-8c0b-870e3989d6aa on hv-cinder-84984 Aug 07 12:33:19.798646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-d153649d-e957-4d14-896b-d966994eba79 req-55f5627c-ad89-4062-80bb-57f2d698e739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035192 Aug 07 12:33:19.799278 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 574/1193] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:20.745983 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:20.746581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:20.752890 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:20.753366 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:20.753800 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:20.754480 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:20.754928 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:20.755601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:20.883511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:20.891145 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-ee0ffd40-3c3d-4099-9f4f-fa3f50a3f8a8 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.148995 Aug 07 12:33:20.891709 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 620/1194] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:20 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:21.912308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:21.913005 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:21.919072 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:21.919556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:21.919992 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:21.920677 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:21.921126 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:21.921550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:22.056268 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:22.063748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-51a636f4-e1d3-423c-a044-bb714a42e370 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.156192 Aug 07 12:33:22.064320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 575/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:21 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:23.084715 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:23.085331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:23.091732 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:23.092212 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:23.092648 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:23.093333 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:23.093874 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:23.094304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:23.455256 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:23.462818 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-553ac8b2-48f0-499e-9111-e3c2e72257ef tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.382680 Aug 07 12:33:23.463441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 621/1196] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:23 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:24.002809 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7fc791-2a98-497e-8c0b-870e3989d6aa", "name": "network-vif-plugged", "status": "completed", "tag": "b3e36915-c599-4170-bc99-c22f39d002ec"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:24.012308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:24.012785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:24.013217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:24.024776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] Creating event network-vif-plugged:b3e36915-c599-4170-bc99-c22f39d002ec for instance fb7fc791-2a98-497e-8c0b-870e3989d6aa on hv-cinder-84984 Aug 07 12:33:24.030229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-5492ae15-3dcd-49af-8b23-28712c3aca0d req-f24097dd-383c-4bbc-b623-abc1a7905dfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087948 Aug 07 12:33:24.030229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 576/1197] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:24.483601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:24.484220 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:24.490825 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:24.491359 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:24.491794 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:24.492477 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:24.492923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:24.493342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:24.619669 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:24.627018 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-17b0e5ba-313f-408c-b8df-21f814f25a27 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.147249 Aug 07 12:33:24.627600 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 622/1198] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:24 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:25.649517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:25.651550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:25.656504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:25.656980 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:25.657409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:25.658091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:25.658538 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:25.658956 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:25.789277 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:25.796690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-de8993b1-6bba-4445-ab50-34b3df2b92c3 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1363 microversion: 2.1 time: 0.152087 Aug 07 12:33:25.797257 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 577/1199] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:25 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:26.817721 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:26.818287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:26.820675 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:26.821328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=6 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:26.826051 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:26.826529 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:26.826988 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:26.827766 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:26.828214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:26.828632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:26.963464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:33:26.970993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-231d3d26-0e82-4ceb-92f7-371a5c82240e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1549 microversion: 2.1 time: 0.157192 Aug 07 12:33:26.971581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 623/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:33:26 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:33:26.994790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:33:26.995332 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:33:26.997287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:33:27.002569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:27.003081 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:27.003526 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:27.004217 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:27.004899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:27.005191 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:27.081742 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7b75bb9c-dd9c-4f94-ac7f-2df7411aee4d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090799 Aug 07 12:33:27.082328 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 578/1201] 10.222.0.30 () {58 vars in 1275 bytes} [Sun Aug 7 12:33:26 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:33:28.046289 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7fc791-2a98-497e-8c0b-870e3989d6aa", "tag": "b3e36915-c599-4170-bc99-c22f39d002ec"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:33:28.056707 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:33:28.057172 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:33:28.057597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:33:28.068978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] Creating event network-changed:b3e36915-c599-4170-bc99-c22f39d002ec for instance fb7fc791-2a98-497e-8c0b-870e3989d6aa on hv-cinder-84984 Aug 07 12:33:28.074033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-4fa2b316-c922-43f9-af5c-3c5998ba79b1 req-6852cee1-a97c-4ba3-bd63-0ba245f4e8d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Aug 07 12:33:28.074623 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 624/1202] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:03.818224 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:03.818772 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:03.821324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:03.821983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:03.826710 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:03.827226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:03.827663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:03.828350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:03.828804 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:03.829225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:03.853169 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3bd21aa7-3df0-4d05-9ab0-caf894289d2d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/ips" status: 200 len: 146 microversion: 2.1 time: 0.038853 Aug 07 12:34:03.853733 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 579/1203] 10.222.0.30 () {58 vars in 1248 bytes} [Sun Aug 7 12:34:03 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:05.442632 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:05.443421 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=64 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:05.447745 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "253639ee-836b-4023-a548-d269853c99d2"}} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:05.450126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:05.456099 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:05.461056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:05.461056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:05.461056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:05.461056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:05.461528 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:06.290080 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-0ed2f8f6-d828-4796-a738-f78630f3f28d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.849398 Aug 07 12:34:06.290687 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 625/1204] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:34:05 2022] POST /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:14.864579 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:14.866832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:14.874021 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:14.874497 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:14.874925 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:14.875624 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:14.876067 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:14.876483 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:14.906724 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5638b544-949d-4192-82aa-0b612615e31d tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 07 12:34:14.907315 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 580/1205] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:34:14 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:14.919245 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:14.919830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:14.925897 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:14.926374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:14.926885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:14.927633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:14.928090 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:14.928514 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:14.957037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-27b06be8-be95-405b-accb-1d59a65704db tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2" status: 200 len: 194 microversion: 2.1 time: 0.042680 Aug 07 12:34:14.957611 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 626/1206] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 12:34:14 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:16.574009 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7208422-6563-4fb9-a53b-4499533a2c65"}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:16.576400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:16.584118 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:16.584607 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:16.585046 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:16.585737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:16.586200 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:16.586622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:17.393426 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-d54a6158-8d4c-4ebe-8a90-89b2d044efb1 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "POST /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823872 Aug 07 12:34:17.394015 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 581/1207] 10.222.0.30 () {60 vars in 1323 bytes} [Sun Aug 7 12:34:16 2022] POST /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:25.969790 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:25.971984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:25.974520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=4 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:25.975201 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:25.980068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:25.980546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:25.981003 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:25.981690 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:25.982157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:25.982580 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:26.011787 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cc32b21a-c941-41eb-8bcb-77c3123309ed tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046002 Aug 07 12:34:26.012343 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 627/1208] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:34:25 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:26.177282 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:26.177926 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:26.184143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:26.184625 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:26.185056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:26.185738 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:26.186183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:26.186600 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:26.216573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-c6041ed6-0e1c-4556-bfb5-f120290f274f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2" status: 200 len: 194 microversion: 2.1 time: 0.044858 Aug 07 12:34:26.217144 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 582/1209] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 12:34:26 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:26.228107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:26.228613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:26.235633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:26.236110 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:26.236538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:26.237217 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:26.237662 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:26.238081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:26.318214 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lazy-loading 'services' on Instance uuid fb7fc791-2a98-497e-8c0b-870e3989d6aa {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:34:26.575452 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4be7b3af-e94f-4cad-85a1-ad1a5e856e39 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2" status: 202 len: 0 microversion: 2.1 time: 0.351923 Aug 07 12:34:26.576178 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 628/1210] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:34:26 2022] DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/253639ee-836b-4023-a548-d269853c99d2 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:34:28.747968 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:28.748476 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:28.755698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:28.756178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:28.756612 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:28.757287 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:28.757737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:28.758190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:28.786234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8538b4a4-ea5c-462d-a2f5-3fd7b613996f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/f7208422-6563-4fb9-a53b-4499533a2c65" status: 200 len: 194 microversion: 2.1 time: 0.042162 Aug 07 12:34:28.786869 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 583/1211] 10.222.0.30 () {58 vars in 1413 bytes} [Sun Aug 7 12:34:28 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/f7208422-6563-4fb9-a53b-4499533a2c65 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:28.798149 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:28.798737 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:28.805597 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:28.806078 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:28.806516 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:28.807241 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:28.807697 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:28.808125 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:28.887207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lazy-loading 'services' on Instance uuid fb7fc791-2a98-497e-8c0b-870e3989d6aa {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:34:29.085304 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dc17559d-6297-4e9f-b757-a260c929a487 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/f7208422-6563-4fb9-a53b-4499533a2c65" status: 202 len: 0 microversion: 2.1 time: 0.291648 Aug 07 12:34:29.085910 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 629/1212] 10.222.0.30 () {58 vars in 1416 bytes} [Sun Aug 7 12:34:28 2022] DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments/f7208422-6563-4fb9-a53b-4499533a2c65 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:34:31.310166 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:31.312377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:31.318621 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.319133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.319567 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.320250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.320696 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.321114 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.349240 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-fcbcbd04-2a49-44c6-afa6-a794328018fe tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042516 Aug 07 12:34:31.349810 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 584/1213] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:34:31 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:34:31.464844 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:31.467185 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:31.473982 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.474462 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.474898 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.475612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.480028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.480028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.504569 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7c8885a1-35c0-47a7-910d-55854cee0151 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044554 Aug 07 12:34:31.505268 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 630/1214] 10.222.0.30 () {58 vars in 1302 bytes} [Sun Aug 7 12:34:31 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 07 12:34:31.565889 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:31.566377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:31.572377 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.572853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.573284 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.573957 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.574597 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.575044 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.600274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:34:31.903622 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8a229fff-6868-41f7-b4f0-efd92babfc5e tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 204 len: 0 microversion: 2.1 time: 0.341166 Aug 07 12:34:31.904225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 585/1215] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:34:31 2022] DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:34:31.912381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:31.913126 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:31.919302 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.919780 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.923426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:31.923426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:31.923426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:31.923426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:32.051208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:32.058664 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-258d3d52-cd1d-4c80-95a4-3ae3f48c598b tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1674 microversion: 2.1 time: 0.150260 Aug 07 12:34:32.059260 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 631/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:31 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:33.081183 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:33.081872 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:33.088407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:33.088887 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:33.089321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:33.090003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:33.090449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:33.090883 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:33.221378 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:33.228860 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-01f174cc-07bf-41c5-8584-9b50aa4fd292 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1674 microversion: 2.1 time: 0.152000 Aug 07 12:34:33.229424 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 586/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:33 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:34.251075 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:34.251689 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:34.258814 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:34.259375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:34.259816 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:34.260517 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:34.260972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:34.261398 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:34.391506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:34.400439 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dd9f47af-7af4-496a-8926-4b05be761981 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1674 microversion: 2.1 time: 0.153296 Aug 07 12:34:34.401020 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 632/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:34 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:35.007902 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7fc791-2a98-497e-8c0b-870e3989d6aa", "name": "network-vif-deleted", "tag": "b3e36915-c599-4170-bc99-c22f39d002ec"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:35.017665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.018143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.018572 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.029997 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] Creating event network-vif-deleted:b3e36915-c599-4170-bc99-c22f39d002ec for instance fb7fc791-2a98-497e-8c0b-870e3989d6aa on hv-cinder-84984 Aug 07 12:34:35.034928 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-30a517b1-a9bd-4a9a-899d-015ab291430d req-9fb0c2da-45d5-4e15-9383-e7e6c32446c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Aug 07 12:34:35.035551 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 587/1219] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:35.327880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:35.328447 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:35.335999 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.336492 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.336933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.337639 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.338100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.338527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.366678 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:34:35.421999 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:35.422697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:35.429080 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.429570 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.430008 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.430702 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.431178 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.431601 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.463513 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.463909 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.464343 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.464787 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lazy-loading 'fault' on Instance uuid fb7fc791-2a98-497e-8c0b-870e3989d6aa {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:34:35.509482 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:35.517265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-709c9311-6673-4a0a-bfa5-4ba8c595dcf9 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1328 microversion: 2.1 time: 0.099370 Aug 07 12:34:35.518036 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 588/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:35 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:34:35.673550 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-f663f6b1-017a-463c-b7e1-b3d361e90824 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 204 len: 0 microversion: 2.1 time: 0.349380 Aug 07 12:34:35.674162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 633/1221] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:34:35 2022] DELETE /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:34:35.682350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:35.683573 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:35.688758 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.689243 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.689679 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.690569 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:35.691049 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:35.691479 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:35.841374 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:35.849965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-43b3c509-5dd0-48d6-8ff1-4b2513b899ce tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1574 microversion: 2.1 time: 0.170824 Aug 07 12:34:35.849965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 589/1222] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:35 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:36.546298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:36.547109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:36.553885 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:36.554444 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:36.554880 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:36.555598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:36.556046 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:36.556465 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:36.587965 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:36.588464 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:36.588902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:36.589353 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lazy-loading 'fault' on Instance uuid fb7fc791-2a98-497e-8c0b-870e3989d6aa {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:34:36.633199 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20f7cd1ed1214372a5c6f441fb98f799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a311cd62403a4fa285c48a145dd9ccfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:36.640980 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-cee79308-6a55-44be-8bb7-7358eb774ddb tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 200 len: 1328 microversion: 2.1 time: 0.098933 Aug 07 12:34:36.641548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 634/1223] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:36 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:36.870550 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:36.871193 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:36.877853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:36.878324 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:36.878753 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:36.880142 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:36.880797 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:36.881222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:37.013043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:37.021452 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1602460a-2565-427d-b207-13953b6488ae tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1574 microversion: 2.1 time: 0.154723 Aug 07 12:34:37.028636 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 590/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:36 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:37.662471 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:37.663109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:37.669135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:37.669619 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:37.670091 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:37.670785 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:37.671278 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:37.671703 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:37.684978 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa HTTP/1.1 Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:34:37.686606 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:37.688355 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'fb7fc791-2a98-497e-8c0b-870e3989d6aa'} Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:37.689322 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:37.690939 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:37.692395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:37.692395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-00323652-f5b3-4e8a-86c0-10a83f288732 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 404 len: 111 microversion: 2.1 time: 0.030269 Aug 07 12:34:37.692395 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 635/1225] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:37 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:34:37.696908 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-1af19bb8-7ca6-4f28-ad20-2373259a85c6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '.version_select at 0x7f77a4214310>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:37.773561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-1af19bb8-7ca6-4f28-ad20-2373259a85c6 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063536073" status: 202 len: 0 microversion: 2.1 time: 0.080351 Aug 07 12:34:37.774140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 591/1226] 10.222.0.30 () {58 vars in 1221 bytes} [Sun Aug 7 12:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2063536073 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:34:38.042546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:38.043190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:38.049059 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:38.049933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:38.050372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:38.051092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:38.051584 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:38.052011 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:38.189993 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:38.198072 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9c5eaa48-9614-49fe-b135-c42c63141f88 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1574 microversion: 2.1 time: 0.159359 Aug 07 12:34:38.198566 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 636/1227] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:38 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:39.056540 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38513b4f-faf9-4847-9f73-54991206231e", "name": "network-vif-deleted", "tag": "d3a418c4-5cb2-46d4-9313-a0f56373cd17"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:39.068861 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:39.069723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:39.070440 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:39.083246 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] Creating event network-vif-deleted:d3a418c4-5cb2-46d4-9313-a0f56373cd17 for instance 38513b4f-faf9-4847-9f73-54991206231e on hv-cinder-84984 Aug 07 12:34:39.089247 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-7b2c976d-d5db-4cb9-982a-c60f05a76407 req-3f9742b0-1bd7-406d-9fa2-bdf2c72b874a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038571 Aug 07 12:34:39.090154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 592/1228] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:39.220088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:39.224859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:39.228271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:39.228968 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:39.229402 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:39.230103 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:39.230548 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:39.231129 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:39.301595 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:39.309476 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-3b40d514-6aff-424a-bdce-83c3383bad27 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1224 microversion: 2.1 time: 0.093282 Aug 07 12:34:39.310797 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 637/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:39 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:40.332979 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:40.333842 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:40.340209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:40.340847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:40.341245 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:40.341942 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:40.342407 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:40.342832 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:40.380003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:40.380003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:40.380003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:40.380003 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lazy-loading 'fault' on Instance uuid 38513b4f-faf9-4847-9f73-54991206231e {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:34:40.424911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:40.432687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-68fe53d5-31c9-4c3e-af49-c462da275ed5 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 200 len: 1229 microversion: 2.1 time: 0.105168 Aug 07 12:34:40.433291 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 593/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:40 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:41.448969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:41.449454 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:41.455981 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.456463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.456894 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.457389 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:41.457815 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.458002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:41.458624 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.458953 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.464881 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.465361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.465789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.466486 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.466939 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.467398 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.472207 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa HTTP/1.1 Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:34:41.474598 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.476331 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'fb7fc791-2a98-497e-8c0b-870e3989d6aa'} Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:41.477451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.478972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.480750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:41.480750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a44bc933-d3d5-41f8-8795-e3a62977d440 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 404 len: 111 microversion: 2.1 time: 0.030829 Aug 07 12:34:41.480750 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 638/1231] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:34:41 2022] DELETE /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:34:41.482535 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] HTTP exception thrown: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:34:41.484028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Request method failure captured: Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e HTTP/1.1 Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi77C44LYkn6xm_7ftwX5mt2Tq3y6E6L76Oh9JqzIKDqe4Cdte6eMgBWH_GvqemKHUWxmqzqZnQ8yfheu4LaAWQJGPw0tPFK5fVbY78zptdpxlv1ojoGJZT5H2TwbwwSGD1cEFclpwAWAKnf4Q7-1i26_OmS2uy6LaU0JeFaCNRTy8xQA Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:34:41.484227 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e2aa26b8ec54387b7c19fc0a2b9438f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-TestVolumeBootPattern-911459821 Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 6c52cd52d25a42e29c8f049c94c903aa Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:34:41.485863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '38513b4f-faf9-4847-9f73-54991206231e'} Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:41.487122 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:34:41.488786 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.490429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: fb7fc791-2a98-497e-8c0b-870e3989d6aa] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:41.490534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Returning 404 to user: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:41.490534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ed2ffb32-b26d-4a2e-9f11-bbdfa4c4bdeb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 404 len: 111 microversion: 2.1 time: 0.032069 Aug 07 12:34:41.490971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.491553 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.491986 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.492673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:41.493124 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:41.493543 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:41.494439 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 594/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:41 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:34:41.507137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa HTTP/1.1 Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:34:41.508685 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.510191 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': 'fb7fc791-2a98-497e-8c0b-870e3989d6aa'} Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:41.510972 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. Aug 07 12:34:41.512321 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:41.513506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance fb7fc791-2a98-497e-8c0b-870e3989d6aa could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:41.513506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-29e9c4b8-aeff-4e7e-a05c-74cfd8246458 tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa" status: 404 len: 111 microversion: 2.1 time: 0.029599 Aug 07 12:34:41.513506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 639/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:41 2022] GET /compute/v2.1/servers/fb7fc791-2a98-497e-8c0b-870e3989d6aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 07 12:34:41.534093 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1326041277", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629497100", "security_groups": [{"name": "tempest-secgroup-smoke-362040585"}], "block_device_mapping_v2": [{"uuid": "5f2d473d-86f6-449a-b153-af550190dc01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88acb47e-551d-472f-8dc2-37ab9f7e112d"}]}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:41.650308 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] validate_networks() for [('88acb47e-551d-472f-8dc2-37ab9f7e112d', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:34:42.065740 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:34:42.066161 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:34:42.066634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:34:42.067064 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:34:42.067501 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:34:42.077083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.081629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.081629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.081629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.081629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.082576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.087151 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:42.097739 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:34:42.102384 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for user 6c52cd52d25a42e29c8f049c94c903aa and project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:34:42.161146 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:34:42.163737 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f2d473d-86f6-449a-b153-af550190dc01',volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:34:42.578256 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-e052b2d9-676c-4b3c-aa0e-f0b56fcb7871 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.047988 Aug 07 12:34:42.579250 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 595/1234] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:34:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:34:42.589659 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-fb9b414e-eb7c-4fee-a33a-40a10a9759b1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:42.590277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-fb9b414e-eb7c-4fee-a33a-40a10a9759b1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:42.645728 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-fb9b414e-eb7c-4fee-a33a-40a10a9759b1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:42.652816 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-fb9b414e-eb7c-4fee-a33a-40a10a9759b1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1094 microversion: 2.1 time: 0.066936 Aug 07 12:34:42.653394 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 640/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:42 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:42.772222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:42.772720 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:42.779222 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.779705 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.780140 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.781150 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.781598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.782040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.795686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db HTTP/1.1 Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:34:42.797361 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.799056 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '32a97721-b0a6-4775-9b66-7b065fd093db'} Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:42.799930 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.801252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.803226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:42.803226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-70a505a0-066e-49ca-8390-cdca61b2478f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 404 len: 111 microversion: 2.1 time: 0.031493 Aug 07 12:34:42.803226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 596/1236] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:34:42 2022] DELETE /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:34:42.807816 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:42.808428 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] [instance: 32a97721-b0a6-4775-9b66-7b065fd093db] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:42.817281 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.821085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.821085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.821085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:42.821085 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:42.821485 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:42.832429 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] HTTP exception thrown: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Request method failure captured: Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db HTTP/1.1 Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77BQC1vaTZIrSH6ulX9_ZqP9DXiXzXTmHG-Hv-8XH3FqKK-MtwcAIxB1qOeCXe0xZKqqDYYBPJRlMzIKiQTmM-mABkUV4CaxWrHDDvwbbMDIe0k6h-hzdDMN4bWBJLLf2_EKKtp_TggqE3TJG14RUAv4LZi1qQ4LXDtqOw_EaYbkf-s Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:34:42.834650 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a311cd62403a4fa285c48a145dd9ccfb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a311cd62403a4fa285c48a145dd9ccfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: a311cd62403a4fa285c48a145dd9ccfb Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-AttachVolumeTestJSON-365052269 Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 20f7cd1ed1214372a5c6f441fb98f799 Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-AttachVolumeTestJSON-365052269-project Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.836519 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '32a97721-b0a6-4775-9b66-7b065fd093db'} Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:34:42.837775 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. Aug 07 12:34:42.839377 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:34:42.840803 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] Returning 404 to user: Instance 32a97721-b0a6-4775-9b66-7b065fd093db could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:34:42.840803 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c2387970-908b-4593-ba00-5252771c813f tempest-AttachVolumeTestJSON-365052269 tempest-AttachVolumeTestJSON-365052269-project] 10.222.0.30 "GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db" status: 404 len: 111 microversion: 2.1 time: 0.032081 Aug 07 12:34:42.840803 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 641/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:42 2022] GET /compute/v2.1/servers/32a97721-b0a6-4775-9b66-7b065fd093db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:34:43.673862 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:43.674524 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:43.681195 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:43.681672 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:43.682197 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:43.682885 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:43.683387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:43.683808 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:43.764623 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:43.772669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-ceabac9b-0c3c-432b-a658-9c1f4ca3ed6a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1144 microversion: 2.1 time: 0.102686 Aug 07 12:34:43.773230 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 597/1238] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:43 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1144 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:44.793360 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:44.793992 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:44.800628 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:44.801116 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:44.801558 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:44.802535 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:44.803403 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:44.804136 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:44.873382 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:44.882542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4987f554-82cd-4c3a-9b3c-257815292934 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1200 microversion: 2.1 time: 0.093229 Aug 07 12:34:44.883782 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 642/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:44 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:45.904921 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:45.907242 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:45.914718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:45.915913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:45.916387 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:45.917112 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:45.917574 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:45.918002 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:46.169024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:46.181789 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-481c1bf7-dd68-4c0d-aa7f-abdb6913341e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1277 microversion: 2.1 time: 0.279280 Aug 07 12:34:46.183043 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 598/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:45 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:46.625634 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f46686e-562c-4d86-801a-d5edd06e5302", "tag": "2f77b8aa-7ce7-4d27-922a-80b091ee6e21"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:46.636847 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:46.637406 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:46.638107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:46.652572 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] Creating event network-changed:2f77b8aa-7ce7-4d27-922a-80b091ee6e21 for instance 4f46686e-562c-4d86-801a-d5edd06e5302 on hv-cinder-84984 Aug 07 12:34:46.658137 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-b49f4639-5670-4af1-b620-f5c0471d8c41 req-37f7125e-686e-451d-966d-826f96af6bce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037949 Aug 07 12:34:46.658989 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 643/1241] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:47.203294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:47.204614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:47.207265 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:47.212406 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:47.212892 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:47.213657 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:47.214018 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:47.214897 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:47.215505 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:47.439089 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:47.448058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a4f72669-f7ff-42e7-92e2-ec465767d6d8 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.248682 Aug 07 12:34:47.461866 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 599/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:47 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:48.470205 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:48.470906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:48.477615 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:48.478099 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:48.478533 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:48.479254 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:48.479711 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:48.480135 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:48.497795 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:48.615186 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:48.622581 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-d5940295-b7f9-411b-ac9e-e366174c31cc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.157156 Aug 07 12:34:48.623531 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 644/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:48 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:49.643409 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:49.644090 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:49.651154 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:49.651646 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:49.652079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:49.652764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:49.653216 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:49.653627 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:49.789480 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:49.796912 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5229e9d5-3078-4f55-b055-151d3cd9991d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.157721 Aug 07 12:34:49.797474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 600/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:49 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:50.819851 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:50.820463 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:50.827133 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:50.827620 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:50.828056 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:50.828741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:50.829193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:50.829618 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:50.959599 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:50.967445 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-b8d47d9b-7427-4f45-b504-90e69a9f0a47 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.152402 Aug 07 12:34:50.968227 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 645/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:50 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:51.989665 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:51.990363 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:51.996934 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:51.997415 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:51.997878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:51.998564 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:51.999035 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:51.999447 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:52.088054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:52.110237 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:52.135019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:52.142653 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-7b2927ce-26f2-4ce3-90d8-ba7fdd8dccbe tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.157386 Aug 07 12:34:52.143251 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 601/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:51 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:53.164033 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:53.164642 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:53.166954 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:53.171859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:53.172337 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:53.172772 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:53.173457 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:53.173996 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:53.174413 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:53.309984 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:53.317375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-07586efb-ac99-41c1-a76f-77dd9a099622 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.157609 Aug 07 12:34:53.317938 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 646/1247] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:53 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:54.337913 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:54.338517 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:54.345487 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:54.345963 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:54.346400 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:54.347106 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:54.347555 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:54.347975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:54.478449 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:54.485836 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-59683a7c-ec36-477f-a7cd-982ef583244f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.152205 Aug 07 12:34:54.486408 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 602/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:54 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:55.507937 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:55.508577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:55.514906 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:55.515673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:55.516107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:55.516786 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:55.517234 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:55.517682 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:55.650117 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:55.657511 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-4179d5fa-da28-414c-b33b-81858447d4eb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.153502 Aug 07 12:34:55.658100 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 647/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:55 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:56.679357 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:56.679966 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:56.686348 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:56.686829 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:56.687294 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:56.687986 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:56.688437 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:56.688868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:56.824798 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:56.832214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-61fb472e-14a1-4015-8bc3-01c916f7eb5f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.157355 Aug 07 12:34:56.832779 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 603/1250] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:56 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:34:57.852613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:57.853310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:57.855714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:34:57.860389 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:57.860876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:57.861316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:57.862012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:57.862459 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:57.862875 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:57.999363 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:58.007859 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-32bd1f7d-61a7-41df-b81e-4e9b9c62ec84 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.159269 Aug 07 12:34:58.008441 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 648/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:57 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:34:58.425233 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f46686e-562c-4d86-801a-d5edd06e5302", "name": "network-vif-plugged", "status": "completed", "tag": "2f77b8aa-7ce7-4d27-922a-80b091ee6e21"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:34:58.435795 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:58.436279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:58.436709 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:58.448629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] Creating event network-vif-plugged:2f77b8aa-7ce7-4d27-922a-80b091ee6e21 for instance 4f46686e-562c-4d86-801a-d5edd06e5302 on hv-cinder-84984 Aug 07 12:34:58.453855 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-2d867d25-cc08-4da6-8bf0-ae97983c316a req-4cba86f3-d24d-48b5-a7f0-2cd46b6c5809 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032506 Aug 07 12:34:58.454718 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 604/1252] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:34:59.029058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:34:59.029679 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:34:59.036422 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:59.038276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:59.038276 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:59.038552 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:34:59.039022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:34:59.039513 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:34:59.173058 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:34:59.180546 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-9a4d5966-50b3-4a1c-a73c-da1f8971a5bc tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.155582 Aug 07 12:34:59.181107 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 649/1253] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:34:59 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:35:00.202776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:35:00.203516 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:35:00.209614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:00.210098 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:00.210533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:00.211229 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:00.211681 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:00.212097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:00.352816 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:35:00.360365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8a166ebe-2291-43f5-acf2-aebb4c478651 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1265 microversion: 2.1 time: 0.162198 Aug 07 12:35:00.360870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 605/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:35:00 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:35:01.381475 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:35:01.382827 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:35:01.389376 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:01.389860 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:01.390298 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:01.391282 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:01.391736 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:01.392167 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:01.525902 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:35:01.533451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-727ace6d-90e1-4d1b-baad-1daa295c8238 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1451 microversion: 2.1 time: 0.155828 Aug 07 12:35:01.533969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 650/1255] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:35:01 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:35:01.552899 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:35:01.557711 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:35:01.560370 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:01.560846 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:01.561274 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:01.561959 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:01.562405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:01.562884 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:01.698507 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:35:01.706425 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-169fa494-2e4e-44fa-9372-c835f99cccc0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1451 microversion: 2.1 time: 0.157271 Aug 07 12:35:01.706994 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 606/1256] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:35:01 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:35:04.248922 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f46686e-562c-4d86-801a-d5edd06e5302", "tag": "2f77b8aa-7ce7-4d27-922a-80b091ee6e21"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:35:04.260157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:35:04.260828 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:35:04.261432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:35:04.273893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] Creating event network-changed:2f77b8aa-7ce7-4d27-922a-80b091ee6e21 for instance 4f46686e-562c-4d86-801a-d5edd06e5302 on hv-cinder-84984 Aug 07 12:35:04.279308 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-740b7a9b-7eb0-4e13-9a51-5193fd03956d req-abc4ca2a-f8da-4aaa-b687-f630c3f60bae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033812 Aug 07 12:35:04.280238 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 651/1257] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:36:40.056790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603f705a-6a56-4977-8254-5953da123b36] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 07 12:36:40.057723 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=15 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:40.059033 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=58 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:40.063704 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-917974691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629497100", "security_groups": [{"name": "tempest-secgroup-smoke-362040585"}], "block_device_mapping_v2": [{"uuid": "d56208ae-6196-45b8-9583-383d3b79f17b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "88acb47e-551d-472f-8dc2-37ab9f7e112d"}]}} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:36:40.176176 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.network.neutron [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] validate_networks() for [('88acb47e-551d-472f-8dc2-37ab9f7e112d', None, None, None, None, None)] {{(pid=118243) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 07 12:36:40.544785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 07 12:36:40.545212 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image limits 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 07 12:36:40.545690 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Flavor pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 07 12:36:40.546104 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Image pref 0:0:0 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 07 12:36:40.546529 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.virt.hardware [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118243) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 07 12:36:40.556001 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:40.556542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:40.556977 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:40.558848 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:40.558848 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:40.558848 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:40.576299 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 07 12:36:40.580350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.quota [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Getting quotas for user 6c52cd52d25a42e29c8f049c94c903aa and project 0e2aa26b8ec54387b7c19fc0a2b9438f. Resources: {'instances', 'cores', 'ram'} {{(pid=118243) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 07 12:36:40.637260 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Going to run 1 instances... {{(pid=118243) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 07 12:36:40.639345 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d56208ae-6196-45b8-9583-383d3b79f17b',volume_size=None,volume_type=None)] {{(pid=118243) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 07 12:36:41.064556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] [603f705a-6a56-4977-8254-5953da123b36] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55122. Aug 07 12:36:41.104011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-0efafbb9-a150-450c-88de-f99c5d20f4b0 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.048027 Aug 07 12:36:41.104011 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 607/1258] 10.222.0.30 () {60 vars in 1147 bytes} [Sun Aug 7 12:36:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 07 12:36:41.112861 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eaffbac6-9468-4032-af66-668d8070c8d6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 07 12:36:41.121503 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=7 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:41.122505 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=40 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:41.127139 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-504aa48f-b2b7-4caa-9284-e1c0f10752a7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:41.127850 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-504aa48f-b2b7-4caa-9284-e1c0f10752a7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:41.190190 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-504aa48f-b2b7-4caa-9284-e1c0f10752a7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:41.197845 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-504aa48f-b2b7-4caa-9284-e1c0f10752a7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1093 microversion: 2.1 time: 0.087232 Aug 07 12:36:41.198527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 652/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:41 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:42.220040 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:42.220678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:42.228529 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:42.229252 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:42.229432 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:42.230131 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:42.230581 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:42.231019 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:42.292334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:42.299863 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-386d755f-6660-40df-8441-927c5b25cfe3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1143 microversion: 2.1 time: 0.084460 Aug 07 12:36:42.300413 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 608/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:42 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:43.322037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:43.322506 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:43.335763 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] [eaffbac6-9468-4032-af66-668d8070c8d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55154. Aug 07 12:36:43.337456 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:43.338022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:43.338486 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:43.339294 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:43.339866 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:43.340295 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:43.405416 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:43.416209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2e794ec0-e44a-48e6-8179-ae9c55daac8e tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1199 microversion: 2.1 time: 0.099293 Aug 07 12:36:43.429829 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 653/1261] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:43 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:44.438234 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:44.438955 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:44.447368 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:44.448105 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:44.449619 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:44.450604 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:44.451079 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:44.451504 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:44.666819 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:44.674474 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-802a9ce9-bd2a-41f3-b58a-fbd8cc16edd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1276 microversion: 2.1 time: 0.240562 Aug 07 12:36:44.675157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 609/1262] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:44 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:45.279658 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9466e280-9a7b-4782-bd11-8a7cec1a1b23", "tag": "b8b8ceaa-1163-4013-bd50-28b0a717cd4b"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:36:45.289577 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:45.290054 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:45.290494 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:45.301674 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] Creating event network-changed:b8b8ceaa-1163-4013-bd50-28b0a717cd4b for instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 on hv-cinder-84984 Aug 07 12:36:45.307841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-75ad1ac1-2f36-4651-863c-4b411a663ec5 req-6db3ceaa-a0bf-41fb-b9d2-8918418323e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031914 Aug 07 12:36:45.308450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 654/1263] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:36:45.696878 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:45.697485 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:45.703790 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:45.704267 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:45.704701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:45.705381 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:45.705830 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:45.706254 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:45.848157 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:45.855591 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3af8c7e6-68c9-413b-8bb0-fd78b0e83782 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.163254 Aug 07 12:36:45.856149 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 610/1264] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:45 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:46.876832 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:46.877541 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:46.884655 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:46.885141 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:46.885582 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:46.886274 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:46.886731 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:46.887192 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:47.020242 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:47.028522 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-42b191b7-a442-4d0b-b86c-2c60afbee277 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.155924 Aug 07 12:36:47.029081 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 655/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:46 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:48.049162 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:48.049774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:48.056375 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:48.056854 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:48.057289 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:48.057975 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:48.058428 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:48.058853 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:48.253326 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:48.261687 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b3d50c74-1598-477e-9133-2f85f7333694 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.216343 Aug 07 12:36:48.262261 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 611/1266] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:48 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:49.282229 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:49.282835 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:49.289426 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:49.289904 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:49.290335 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:49.291120 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:49.291570 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:49.291991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:49.425730 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:49.433888 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-dd3ecd7f-9701-4581-993f-1704aa34543f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.155520 Aug 07 12:36:49.434450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 656/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:49 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:50.456320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:50.456981 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:50.464070 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:50.464547 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:50.464983 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:50.465669 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:50.466123 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:50.466542 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:50.567022 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=2 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:50.587698 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell0:SELECT=6 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:50.601466 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:50.608870 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-8103c3d8-f2e8-42ad-b2a2-3d6b91cfea78 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.156331 Aug 07 12:36:50.609435 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 612/1268] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:50 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:51.630375 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:51.631138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:51.633603 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell0:SELECT=2 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:36:51.638450 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:51.639088 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:51.639525 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:51.640209 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:51.640663 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:51.641082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:51.771842 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:51.779187 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-43b97a84-3cbc-416d-8564-3d3b09330a68 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.152931 Aug 07 12:36:51.779747 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 657/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:51 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 07 12:36:52.800221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:52.800868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:52.808262 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:52.808747 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:52.809202 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:52.809873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:52.810322 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:52.810748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:52.948686 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:52.956106 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-3016fad5-c13e-444a-bcfd-8e8489e7e9c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.160331 Aug 07 12:36:52.956670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 613/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:52 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:53.977037 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:53.977729 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:53.984305 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:53.984783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:53.985218 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:53.985971 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:53.986419 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:53.986841 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:54.122448 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:54.130000 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-a0bc4f89-9f9a-491e-bd99-28e3ef043b72 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.157089 Aug 07 12:36:54.130561 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 658/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:53 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:55.152334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:55.152944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:55.159470 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:55.159961 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:55.160405 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:55.161102 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:55.161559 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:55.161991 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:55.297285 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:55.306321 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-253c6862-8410-4560-8fee-2120cf78e59f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.158838 Aug 07 12:36:55.306917 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 614/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:55 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:56.326973 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:56.327830 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:56.335053 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:56.335759 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:56.336374 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:56.337143 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:56.337661 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:56.338162 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:56.473547 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:56.481482 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-2d8a55b3-30dc-410c-bad1-7a9e6c4bcbcb tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.158450 Aug 07 12:36:56.482041 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 659/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:56 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:57.503443 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:57.504058 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:57.511052 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:57.511532 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:57.511967 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:57.512647 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:57.513095 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:57.513515 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:57.648693 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:57.656518 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-f9f7aa64-ab18-43b9-b7d6-303382381496 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.156870 Aug 07 12:36:57.657083 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 615/1274] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:57 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:58.231022 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466e280-9a7b-4782-bd11-8a7cec1a1b23", "name": "network-vif-plugged", "status": "completed", "tag": "b8b8ceaa-1163-4013-bd50-28b0a717cd4b"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:36:58.241393 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:58.241876 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:58.242309 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:58.254594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] Creating event network-vif-plugged:b8b8ceaa-1163-4013-bd50-28b0a717cd4b for instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 on hv-cinder-84984 Aug 07 12:36:58.260327 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-2cd4e076-b634-47f3-a104-c009ac966fc8 req-6bfc6d20-fdbc-4d00-b3a1-8c3175c1620d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Aug 07 12:36:58.261032 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 660/1275] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:36:58.800761 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:58.801440 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:58.808182 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:58.808662 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:58.809097 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:58.809904 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:58.810352 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:58.810859 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:58.947051 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:36:58.954671 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-6310823e-240b-4206-94a3-5e56770c1fd3 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.281412 Aug 07 12:36:58.955272 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 616/1276] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:58 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:36:59.574838 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:36:59.575225 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Sun Aug 7 12:36:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:36:59.977609 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:36:59.978479 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:36:59.985714 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:59.986310 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:59.986784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:36:59.987520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:36:59.987980 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:36:59.988407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:00.128527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:37:00.137533 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-92cf1f0c-3db2-40e9-aefc-546c75e63405 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1264 microversion: 2.1 time: 0.164679 Aug 07 12:37:00.138206 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 661/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:36:59 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:37:01.158209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:37:01.159087 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:37:01.165596 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:37:01.166258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:37:01.168177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:01.168177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:37:01.168177 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:37:01.168773 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:01.325965 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:37:01.334133 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-75291c81-0b2f-40ab-acb3-3edf19bad37b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1450 microversion: 2.1 time: 0.179760 Aug 07 12:37:01.334713 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 617/1278] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:37:01 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1450 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:37:01.353940 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:37:01.354550 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:37:01.361342 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:37:01.361753 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:37:01.362196 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:01.362882 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:37:01.363350 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:37:01.363783 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:01.525138 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:37:01.532959 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e03df3e8-ff8b-4dd4-a2d2-6654d6363d5d tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1450 microversion: 2.1 time: 0.182929 Aug 07 12:37:01.533538 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 662/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:37:01 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1450 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:37:03.800223 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9466e280-9a7b-4782-bd11-8a7cec1a1b23", "tag": "b8b8ceaa-1163-4013-bd50-28b0a717cd4b"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:37:03.810697 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:37:03.811221 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:37:03.811654 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:37:03.823431 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] Creating event network-changed:b8b8ceaa-1163-4013-bd50-28b0a717cd4b for instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 on hv-cinder-84984 Aug 07 12:37:03.828764 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-1cac6770-7b66-4e1c-9976-e18143b5e9f2 req-0548633b-c51c-4656-953d-9835bf3e29f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032085 Aug 07 12:37:03.829436 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 618/1280] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:38:18.247316 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:38:18.247856 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:38:38.724822 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:38:38.725554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:38:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:38:43.195604 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_api:SELECT=24 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:38:43.196801 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG dbcounter [-] [118242] Writing DB stats nova_cell1:SELECT=52 {{(pid=118242) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:38:43.198135 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR oslo.messaging._drivers.impl_rabbit [-] [603f705a-6a56-4977-8254-5953da123b36] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 07 12:38:43.198743 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:38:43.199520 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG dbcounter [-] [118243] Writing DB stats nova_cell1:SELECT=64 {{(pid=118243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 12:38:43.201144 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:43.202271 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:43.208427 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:43.208915 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:43.209352 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:43.210049 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:43.210499 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:43.211225 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:43.239082 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Going to try to terminate instance {{(pid=118242) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:38:43.336598 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9466e280-9a7b-4782-bd11-8a7cec1a1b23", "tag": "b8b8ceaa-1163-4013-bd50-28b0a717cd4b"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:38:43.347232 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:43.347707 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:43.348134 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:43.360121 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] Creating event network-changed:b8b8ceaa-1163-4013-bd50-28b0a717cd4b for instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 on hv-cinder-84984 Aug 07 12:38:43.365873 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-970adb8b-5f90-456b-924b-828cf076a5df req-baabbd1f-0911-463c-96a3-6a8c2ea9df30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169353 Aug 07 12:38:43.366748 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 619/1281] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:38:43.494362 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-77e568d9-2d92-428b-ae27-86106c58de53 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 204 len: 0 microversion: 2.1 time: 0.300680 Aug 07 12:38:43.495573 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 663/1282] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:38:43 2022] DELETE /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:38:43.508249 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:43.509402 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:43.515919 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:43.516534 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:43.516970 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:43.517880 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:43.518334 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:43.519024 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:43.718678 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:43.726088 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-61d0a39f-8ef2-493d-9ff4-bfbd87e4d5fd tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1575 microversion: 2.1 time: 0.225255 Aug 07 12:38:43.726644 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 620/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:43 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:44.747923 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:44.748739 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:44.755432 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:44.755914 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:44.756346 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:44.757028 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:44.757481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:44.757901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:44.942405 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:44.950038 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-e9ddc788-d3eb-4853-8aae-418627215133 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1575 microversion: 2.1 time: 0.206403 Aug 07 12:38:44.950602 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 664/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:44 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:45.974203 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:45.976502 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:45.985867 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:45.986365 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:45.987450 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:45.988544 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:45.989226 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:45.990027 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:46.023911 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] [603f705a-6a56-4977-8254-5953da123b36] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 55456. Aug 07 12:38:46.069366 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:46.077824 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-a556db6f-56e1-4330-a396-a58f5a6bbb6f tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1389 microversion: 2.1 time: 0.108479 Aug 07 12:38:46.078388 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 621/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:45 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1389 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:46.098919 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9466e280-9a7b-4782-bd11-8a7cec1a1b23", "name": "network-vif-deleted", "tag": "b8b8ceaa-1163-4013-bd50-28b0a717cd4b"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:38:46.109210 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:46.109684 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:46.110392 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:46.121157 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] Creating event network-vif-deleted:b8b8ceaa-1163-4013-bd50-28b0a717cd4b for instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 on hv-cinder-84984 Aug 07 12:38:46.126777 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-59f08643-565a-4052-b589-e1f69cc440d6 req-2eaf61d2-1b67-4107-aca6-cdfb02fbf44b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091858 Aug 07 12:38:46.132473 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 665/1286] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:38:47.099320 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:47.099868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:47.106189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:47.106663 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:47.107119 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:47.107905 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:47.108350 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:47.108847 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:47.141300 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:47.141760 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:47.142189 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:47.142631 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.objects.instance [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lazy-loading 'fault' on Instance uuid 9466e280-9a7b-4782-bd11-8a7cec1a1b23 {{(pid=118243) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:38:47.184971 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:47.193201 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-5887d421-806e-4cf3-9a6a-d214797fdac2 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 200 len: 1229 microversion: 2.1 time: 0.097851 Aug 07 12:38:47.193767 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 622/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:47 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:48.215933 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:48.216562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 9466e280-9a7b-4782-bd11-8a7cec1a1b23] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:48.223328 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:48.223817 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:48.224259 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:48.224952 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:48.225407 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:48.225836 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:48.239470 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] HTTP exception thrown: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Request method failure captured: Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 HTTP/1.1 Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77C44LYkn6xm_7ftwX5mt2Tq3y6E6L76Oh9JqzIKDqe4Cdte6eMgBWH_GvqemKHUWxmqzqZnQ8yfheu4LaAWQJGPw0tPFK5fVbY78zptdpxlv1ojoGJZT5H2TwbwwSGD1cEFclpwAWAKnf4Q7-1i26_OmS2uy6LaU0JeFaCNRTy8xQA Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:38:48.241092 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e2aa26b8ec54387b7c19fc0a2b9438f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 6c52cd52d25a42e29c8f049c94c903aa Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. Aug 07 12:38:48.242893 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '9466e280-9a7b-4782-bd11-8a7cec1a1b23'} Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:38:48.243991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. Aug 07 12:38:48.245481 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:48.246946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Returning 404 to user: Instance 9466e280-9a7b-4782-bd11-8a7cec1a1b23 could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:38:48.246946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-c39357be-d488-4e35-90bb-02152ec39a76 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23" status: 404 len: 111 microversion: 2.1 time: 0.031388 Aug 07 12:38:48.246946 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 666/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:48 2022] GET /compute/v2.1/servers/9466e280-9a7b-4782-bd11-8a7cec1a1b23 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:38:51.464769 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:51.467587 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:51.467889 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f46686e-562c-4d86-801a-d5edd06e5302", "tag": "2f77b8aa-7ce7-4d27-922a-80b091ee6e21"}]} {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:38:51.473124 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:51.473614 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:51.474214 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:51.474903 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:51.475556 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:51.475974 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:51.476509 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:51.477613 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:51.478272 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:51.491205 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.compute.server_external_events [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] Creating event network-changed:2f77b8aa-7ce7-4d27-922a-80b091ee6e21 for instance 4f46686e-562c-4d86-801a-d5edd06e5302 on hv-cinder-84984 Aug 07 12:38:51.496554 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [req-9e4364e1-31e9-416a-a960-aa0dd91c71d6 req-ac887f35-5ea1-43ef-9726-8956a18570b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034414 Aug 07 12:38:51.497156 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 667/1289] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 07 12:38:51.506209 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Going to try to terminate instance {{(pid=118243) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 07 12:38:51.763576 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-477fb0df-0a8c-4d22-b44f-93d360cd43df tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 204 len: 0 microversion: 2.1 time: 0.303314 Aug 07 12:38:51.765392 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 623/1290] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:38:51 2022] DELETE /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 07 12:38:51.774381 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:51.775182 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:51.781527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:51.782019 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:51.782635 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:51.783372 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:51.783821 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:51.784443 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:51.917555 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:51.925168 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-86d2c6b1-aa0f-4084-a9a3-e42803af86d1 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1575 microversion: 2.1 time: 0.155007 Aug 07 12:38:51.925741 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 668/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:51 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:52.946960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:52.947676 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:52.954626 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:52.955152 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:52.955580 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:52.956258 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:52.956701 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:52.957115 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:53.105441 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.policy [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118243) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:53.113463 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-400c6250-8a48-479f-be74-90bdfd5d3bec tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1575 microversion: 2.1 time: 0.170664 Aug 07 12:38:53.114071 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 624/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:52 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:54.134764 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:54.135410 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:54.141867 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:54.142344 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:54.142784 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:54.144012 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:54.144193 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:54.144612 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:54.281878 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:54.289402 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-7be0c878-1b1a-4f1f-9608-7796817c5c71 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1457 microversion: 2.1 time: 0.158467 Aug 07 12:38:54.289969 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 669/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:54 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:54.430401 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f46686e-562c-4d86-801a-d5edd06e5302", "name": "network-vif-deleted", "tag": "2f77b8aa-7ce7-4d27-922a-80b091ee6e21"}]} {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 07 12:38:54.440670 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:54.441143 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:54.441563 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:54.453151 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.compute.server_external_events [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] Creating event network-vif-deleted:2f77b8aa-7ce7-4d27-922a-80b091ee6e21 for instance 4f46686e-562c-4d86-801a-d5edd06e5302 on hv-cinder-84984 Aug 07 12:38:54.458048 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [req-6a49efbe-fc6b-455c-a2dd-ba4fcdd64362 req-a4a7a2bb-e0b7-43bd-915d-6632523476d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Aug 07 12:38:54.458629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 625/1294] 10.222.0.30 () {64 vars in 1317 bytes} [Sun Aug 7 12:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 07 12:38:55.311134 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:55.311673 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:55.318601 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:55.323901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:55.323901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:55.323901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:55.323901 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:55.324312 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:55.350095 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:55.350560 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:55.350991 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:55.351451 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.objects.instance [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lazy-loading 'fault' on Instance uuid 4f46686e-562c-4d86-801a-d5edd06e5302 {{(pid=118242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 07 12:38:55.392542 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.policy [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c52cd52d25a42e29c8f049c94c903aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2aa26b8ec54387b7c19fc0a2b9438f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118242) authorize /opt/stack/nova/nova/policy.py:199}} Aug 07 12:38:55.400489 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-379fb147-076f-4b6b-8a9c-abed30c0df8b tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 200 len: 1230 microversion: 2.1 time: 0.093405 Aug 07 12:38:55.401068 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 670/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:55 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 07 12:38:56.422785 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:56.423533 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 4f46686e-562c-4d86-801a-d5edd06e5302] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:56.429578 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.430054 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.430484 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.431190 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.431634 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.432050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.445385 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] HTTP exception thrown: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Request method failure captured: Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 HTTP/1.1 Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi77C44LYkn6xm_7ftwX5mt2Tq3y6E6L76Oh9JqzIKDqe4Cdte6eMgBWH_GvqemKHUWxmqzqZnQ8yfheu4LaAWQJGPw0tPFK5fVbY78zptdpxlv1ojoGJZT5H2TwbwwSGD1cEFclpwAWAKnf4Q7-1i26_OmS2uy6LaU0JeFaCNRTy8xQA Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:38:56.446960 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e2aa26b8ec54387b7c19fc0a2b9438f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 6c52cd52d25a42e29c8f049c94c903aa Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. Aug 07 12:38:56.448561 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '4f46686e-562c-4d86-801a-d5edd06e5302'} Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:38:56.449458 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. Aug 07 12:38:56.451473 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.453868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Returning 404 to user: Instance 4f46686e-562c-4d86-801a-d5edd06e5302 could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:38:56.453868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-b5e8930b-5191-4f6f-9dc5-2b6e43c0f13a tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302" status: 404 len: 111 microversion: 2.1 time: 0.030364 Aug 07 12:38:56.453868 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 626/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:56 2022] GET /compute/v2.1/servers/4f46686e-562c-4d86-801a-d5edd06e5302 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:38:56.931520 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:56.932029 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.compute.api [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118242) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:56.938633 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.939159 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.939594 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.940277 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.940726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.941150 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG oslo_concurrency.lockutils [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118242) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.954527 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.wsgi [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] HTTP exception thrown: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Request method failure captured: Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: request: DELETE /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e HTTP/1.1 Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept: application/json Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Accept-Encoding: identity Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Connection: close Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Length: 0 Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Content-Type: application/json Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Host: 10.222.0.30 Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Openstack-System-Scope: None Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: User-Agent: python-urllib3/1.26.11 Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Auth-Token: gAAAAABi77C44LYkn6xm_7ftwX5mt2Tq3y6E6L76Oh9JqzIKDqe4Cdte6eMgBWH_GvqemKHUWxmqzqZnQ8yfheu4LaAWQJGPw0tPFK5fVbY78zptdpxlv1ojoGJZT5H2TwbwwSGD1cEFclpwAWAKnf4Q7-1i26_OmS2uy6LaU0JeFaCNRTy8xQA Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Id: None Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Domain-Name: None Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Identity-Status: Confirmed Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Is-Admin-Project: True Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Id: default Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Domain-Name: Default Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Project-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Role: member,reader Aug 07 12:38:56.956208 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Roles: member,reader Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e2aa26b8ec54387b7c19fc0a2b9438f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-Tenant-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Id: default Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Domain-Name: Default Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Id: 6c52cd52d25a42e29c8f049c94c903aa Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: X-User-Name: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: method: > Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: exception: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.957793 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: action_args: {'id': '38513b4f-faf9-4847-9f73-54991206231e'} Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:38:56.958672 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.960109 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.961500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Returning 404 to user: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. {{(pid=118242) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:38:56.961500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-5cf98868-1f4e-4892-acca-76d63ea466c7 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 404 len: 111 microversion: 2.1 time: 0.029914 Aug 07 12:38:56.961500 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 671/1297] 10.222.0.30 () {58 vars in 1239 bytes} [Sun Aug 7 12:38:56 2022] DELETE /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:38:56.966172 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '>' {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:56.966776 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.compute.api [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] [instance: 38513b4f-faf9-4847-9f73-54991206231e] Fetching instance by UUID {{(pid=118243) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 07 12:38:56.973380 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.973849 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.974279 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.974944 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Acquiring lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 07 12:38:56.975421 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 07 12:38:56.975835 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG oslo_concurrency.lockutils [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Lock "dd61ef53-90bb-452d-97fc-c001e8d92e91" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118243) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 07 12:38:56.991936 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.wsgi [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] HTTP exception thrown: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Request method failure captured: Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: request: GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e HTTP/1.1 Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept: application/json Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Accept-Encoding: identity Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Connection: close Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Length: 0 Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Content-Type: application/json Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Host: 10.222.0.30 Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Openstack-System-Scope: None Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: User-Agent: python-urllib3/1.26.11 Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Auth-Token: gAAAAABi77C44LYkn6xm_7ftwX5mt2Tq3y6E6L76Oh9JqzIKDqe4Cdte6eMgBWH_GvqemKHUWxmqzqZnQ8yfheu4LaAWQJGPw0tPFK5fVbY78zptdpxlv1ojoGJZT5H2TwbwwSGD1cEFclpwAWAKnf4Q7-1i26_OmS2uy6LaU0JeFaCNRTy8xQA Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Id: None Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Domain-Name: None Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Identity-Status: Confirmed Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Is-Admin-Project: True Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Id: default Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Domain-Name: Default Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Project-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Role: member,reader Aug 07 12:38:56.993433 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Roles: member,reader Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0e2aa26b8ec54387b7c19fc0a2b9438f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0e2aa26b8ec54387b7c19fc0a2b9438f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Id: 0e2aa26b8ec54387b7c19fc0a2b9438f Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-Tenant-Name: tempest-TestVolumeBootPattern-911459821 Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Id: default Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Domain-Name: Default Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Id: 6c52cd52d25a42e29c8f049c94c903aa Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: X-User-Name: tempest-TestVolumeBootPattern-911459821-project Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: method: > Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: exception: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.995196 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: action_args: {'id': '38513b4f-faf9-4847-9f73-54991206231e'} Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: {{(pid=118243) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 07 12:38:56.996186 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. Aug 07 12:38:56.997774 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: ERROR nova.api.openstack.wsgi Aug 07 12:38:56.999371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: DEBUG nova.api.openstack.wsgi [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Returning 404 to user: Instance 38513b4f-faf9-4847-9f73-54991206231e could not be found. {{(pid=118243) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 07 12:38:56.999371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO nova.api.openstack.requestlog [None req-db37c150-4f16-4509-a5cc-24e179c60d59 tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e" status: 404 len: 111 microversion: 2.1 time: 0.032399 Aug 07 12:38:56.999371 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: [pid: 118243|app: 0|req: 627/1298] 10.222.0.30 () {58 vars in 1236 bytes} [Sun Aug 7 12:38:56 2022] GET /compute/v2.1/servers/38513b4f-faf9-4847-9f73-54991206231e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 07 12:38:58.504526 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: DEBUG nova.api.openstack.wsgi [None req-71f82233-36ac-454e-a172-5c206964b3be tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] Calling method '.version_select at 0x7f7797f4f550>' {{(pid=118242) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 07 12:38:58.581292 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO nova.api.openstack.requestlog [None req-71f82233-36ac-454e-a172-5c206964b3be tempest-TestVolumeBootPattern-911459821 tempest-TestVolumeBootPattern-911459821-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-629497100" status: 202 len: 0 microversion: 2.1 time: 0.081255 Aug 07 12:38:58.582007 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: [pid: 118242|app: 0|req: 672/1299] 10.222.0.30 () {58 vars in 1260 bytes} [Sun Aug 7 12:38:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-629497100 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 07 12:40:19.584489 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:40:19.585050 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Sun Aug 7 12:40:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:41:38.255726 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:41:38.256279 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:41:58.733562 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:41:58.734287 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:42:05.141091 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:42:05.141629 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Sun Aug 7 12:42:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:42:11.681805 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:42:11.682528 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Sun Aug 7 12:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:43:39.592894 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:43:39.593620 dv-cinder-849846-8-iscsi devstack@n-api.service[118243]: Sun Aug 7 12:43:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 07 12:44:04.221691 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 07 12:44:04.222244 dv-cinder-849846-8-iscsi devstack@n-api.service[118242]: Sun Aug 7 12:44:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!